Contents 



1 Introduction 5 

1.1 The Exponent u of Matrix Multiplication 5 

1.2 Groups and Matrix Multiplication 6 

1.2.1 Realizing Matrix Multiplications via Finite Groups 6 

1.2.2 Wedderburn's Theorem 7 

1.2.3 A Group-theoretic DFT Algorithm for Matrix Multiplication 7 

1.2.4 The Complexity of Matrix Multiplications Realized by Groups 8 

1.2.5 Relations and Results for the Exponent u 8 

1.2.6 Realizing Simultaneous, Independent Matrix Multiplications via Groups . 9 

1.2.7 Estimates for the Exponent lu 11 

2 Algebraic Complexity of Matrix Multipli- 
cation 12 

2.1 Bilinear Complexity of Matrix Multiplication 12 

2.1.1 Matrix Multiplication as a Bilinear Map 12 

2.1.2 Rank of Matrix Multiplication 13 

2.1.3 Matrix Algebras 17 

2.1.4 The Rank of 2 x 2 Matrix Multiplication is at most 7 19 

2.2 Asymptotic Complexity of Matrix Multiplication 21 

2.2.1 The Exponent of Matrix Multiplication 21 



1 



2.2.2 Relations between the Rank of Matrix Multiplication and the Exponent to . 23 

3 Basic Representation Theory 25 

3.1 Basic Representation Theory and Character Theory of Finite Groups 25 

3.1.1 Representations, CG-Modules and Characters 25 

3.1.2 Canonical Decompositions for Regular Representations, CG-Modules, and 
Characters 28 

3.1.3 Induced and Restricted Representations, CG-Modules, and Characters . . 30 

3.1.4 Irreducible Character Degrees 31 

3.1.5 Estimates for Sums of Powers of Irreducible Character Degrees 32 

3.1.6 Estimates for Maximal Irreducible Character Degrees 34 

3.2 Regular Group Algebras 36 

3.2.1 Canonical Decomposition 36 

3.2.2 Multiplicative Complexity and Rank 37 

3.3 Generalized Group Discrete Fourier Transforms 38 

3.3.1 Generalized Group Discrete Fourier Transforms 38 

3.3.2 Discrete Fourier Transform on Sym^ 40 

3.3.3 Complexity and Fast Fourier Transform (FFT) Algorithms 41 

4 Groups and Matrix Multiplication I 42 

4.1 Realizing Matrix Multiplication via Groups 42 

4.1.1 Groups and Index Triples 42 

4.1.2 Extension Results for Index Triples 46 

4.1.3 Groups and Matrix Tensors 48 

4.1.4 Extension Results for Matrix Tensors 50 

4.1.5 Group- Algebra Embedding and Complexity of Matrix Multiplication .... 51 

4.2 The Complexity of Matrix Multiplication Realized by Groups . 54 

4.2.1 Pseudoexponents 54 

4.2.2 The Parameters 7 59 

4.3 Fundamental Relations between a, 7 and the Exponent u .... 61 



2 



4.3.1 Preliminaries 61 

4.3.2 Fundamental Results for the Exponent co using Single non-Abelian Groups 64 

4.3.3 Fundamental Results for the Exponent to using Families of non-Abelian 
Groups 65 

5 Groups and Matrix Multiplication II 68 

5.1 Realizing Simultaneous, Independent Matrix Multiplications 

in Groups 68 

5.1.1 Groups and Families of Simultaneous Index Triples and Tensors 68 

5.1.2 Group-Algebra Embedding and Complexity of Simultaneous, Independent 
Matrix Multiplications 69 

5.1.3 Extension Results 73 

5.2 Some Useful Groups 74 

5.2.1 The Triangle Set A n and the Symmetric Group Sym n ( n+1 y2 74 

5.2.2 Semidirect Product and Wreath Product Groups 77 

6 Applications 84 

6.1 Analysis of a and 7 for the Symmetric Groups 84 

6.1.1 Estimates for 7 (Sym (A n )) 84 

6.1.2 An Upper Estimate for a(Sym (A n ) 86 

6.1.3 An Upper Estimate for a(Sym n ) 88 

6.1.4 Applications to u 89 

6.2 Some Estimates for the Exponent u 90 

6.2.1 u < 2.82 via Cyc$ 91 

6.2.2 u < 2.93 via Cycff I Sym 2 91 

6.2.3 lo < 2.82 via (Cyc^) x25 I Sym 2 25 92 



3 



Acknowledgements 

This Masters thesis was submitted to the Board of Examiners in partial fulfillment of the 
requirements for the degree of Master of Science in Logic at the Universiteit van Amsterdam 
(UvA), The Netherlands, on August 21, 2007. Members of the Board of Examiners were: 

Prof. Dick de Jongh, Institute for Logic, Language and Computation (ILLC), 

UvA 

Prof. Tom Koornwinder, Korteweg de Vries (KdV) Institute for Mathematics, 

UvA 

Prof. Peter van Emde Boas, KdV Institute for Mathematics, UvA 
Prof. Robert van der Waall, KdV Institute for Mathematics, UvA 

The thesis was completed under the kind supervision of Prof. Tom Koornwinder of the 
Korteweg de Vries (KdV) Institute for Mathematics. 

The author also acknowledges the help of Prof. Peter van Emde Boas of the ILLC in 
relation to Chapter 2 dealing with the algebraic theory of complexity of matrix multiplication, 
and of Prof. R. van der Waal of the KdV Institute in relation to Chapter 3 dealing with the 
representation theory of finite groups. 

Acknowledgements are also due to the coauthors of the papers on which the thesis is based, 
Dr. Chris Umans (Dept. of Computer Science, California Institute of Technology), and Dr. 
Henry Cohn (Microsoft Research), for some clarifying remarks and comments. 



4 



Chapter 1 



Introduction 



1.1 The Exponent u of Matrix Multiplication 

Matrix multiplication is a fundamental operation in linear algebra. For any given field K, 
the (asymptotic) complexity of matrix multiplication over K is measured by a real parameter 
oj{K) > 0, called the exponent of matrix multiplication over K, which is defined to be the small- 
est real number to > such that for an arbitrary degree of precision e > 0, two nxn K-matrices 
can be multiplied using an algorithm using 0(n ul+e ) number of non-division arithmetical oper- 
ations, i.e. less than some constant > 1 multiple of n^ +e number of multiplications, additions 
or subtractions. The notation w(K) indicates a dependency on the ground field K, but we 
usually have in mind the complex field K = C, which is general enough for most purposes. 
It is proved that to determines the complexities of many other linear operations, e.g. matrix 
inversion, determinants, etc., and these are concisely covered by Biirgisser et. al., Chapter 16 
in [BCS1997]. 

If we denote by Mk (n) the total number of arithmetical operations for performing nxn 
matrix multiplication over a field K, then by the standard algorithm, Mk {n) = 2n 3 — n 2 = 
0(n 3 ), because one needs to perform n 3 multiplications, and n 3 — n 2 additions of the resulting 
products. This is equivalent to an upper bound of 3 for u. Since the product of two nxn 
matrices consists of n 2 entries, one needs to perform a total number of operations which is at 
least some constant > 1 multiple of the n 2 entries. This is written as Mft-(n) = Q(n 2 ), which 
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is equivalent to a lower bound of 2 for w. Strassen in 1969 obtained the first important result 
that oj < 2.81 using his result that 2x2 matrix multiplication could be performed using 7 
multiplications, not 8, as in the standard algorithm [STR1969, p. 355]. In 1984, Pan improved 
this to 2.67, using a variant of Strassen's approach [PAN1984, p. 400]. It has been conjectured 
for twenty years that cj = 2, but the best known result is that to < 2.38, due to Coppersmith 
and Winograd [CW1990, p. 251]. In all these approaches, estimates for oj depend on the 
number of main running steps in their algorithms. 



1.2 Groups and Matrix Multiplication 

In a recent series of papers in 2003 and 2005, Cohn and Umans put forward an entirely different 
approach using fairly elementary methods from group theory to describe the complexity of 
matrix multiplication. 

The approach is based on two important facts. 
1.2.1 Realizing Matrix Multiplications via Finite Groups 

(I) A (nontrivial) finite group G which has a triple of index subsets S, T, U C G of sizes 
\S\ = n, \T\ = m, \U\ = p, such that s s _1 i' u" 1 = 1q s's -1 = t't" 1 = uu^ 1 = 1q, 
for all elements s',seS,t',teT,u',ueU, realizes multiplication of n x m by m x p matrices 
over C, in the sense that the entries of a given n x m complex matrix A = (Aij) and an 
m x p matrix B = (Bkj), can be indexed by the subsets S, T, U as A = (^s,t) stSttT and 
B = (Bt',u) t i eTu tU ) then injectively embedded in the regular group algebra CG of G as the 
elements A = A s js~ 1 t and B = J2 B t > tU t'~ 1 u, and the matrix product AB can 

s e S,t eT t' eT,ueU 

be computed by the rule that the s , u -th entry {AB) s n u » is the coefficient of the term s _1 n 
in the group algebra product AB = Yl Yl A Sit B t i u s~ l tt'~ l u (see Theorem 4-13). 

seS,teT t > eT ,ueU 

In this case, by definition, G is said to support n x m by m xp matrix multiplication, equivalently, 
to realize the matrix tensor (n, m,p), whose size we define as nmp, and the subsets S, T, U 



6 



are said to have the triple product property (TPP) and be an index triple of G corresponding 
to the tensor (n,m,p) (see Chapter 4)- 



1.2.2 Wedderburn's Theorem 



(II) By Wedderburn's theorem there is an isomorphism CG = © £d e xd Q f ^ re g U i ar 

q e IrrepiG) 

group algebra CG of G, where © £,d e xd e j g a block-diagonal matrix algebra of dimension 

g e IrrepiG) 

d 2 e = |G|, and the <C d e xd e are its irreducible subalgebras of dimensions cP g , and the d e 

q e IrrepiG) 

are the degrees of the distinct irreducible characters of G, i.e. the dimensions d g = Dim g of the 
distinct (inequivalent) irreducible representations g e Irrep(G) of G. Any such isomorphism 
constitutes a group discrete Fourier transform (DFT) for G, and, further, we can deduce that 
\G\ < fH(m CG ) < Yl yt({d s ,d e ,d e )), where fK(m CG ) and £H ((d e , d e , d e )) are the ranks of 

g e Irrep(G) 

the bilinear multiplication maps m CG and (d Q ,d Q ,dg) in CG and C d e xd e : respectively. 



1.2.3 A Group-theoretic DFT Algorithm for Matrix Multiplication 

This suggests the following group-theoretic DFT algorithm for n x n matrix multiplication via 
a finite group G realizing nxn matrix multiplication via subsets S, T, U CG having the triple 
product property. 

1. Injectively embed nxn complex matrices A = (Aj)i<jj< n an d B = (By A t 
into CG as elements A = A s<t s~ 1 t and B = B t i, u t'^ 1 u via S, T, U (as 

s e S,teT f e T, u e U 

described in (I)). 

2. Use a discrete group Fourier transform (DFT) for G, DFT : CG ^ © C d e x <i e to 

g e Irrep(G) 

compute the transforms A = DFT (A) and B = DFT(B). 

3. Compute the block-diagonal matrix product of transforms, G = AB. 

4. Recover the vector AB = G = DFT^ 1 (c^J from its transform by the inverse group DFT. 
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5. Fill the matrix AB from AB = J2 J2 A Sjt B t > u s~ 1 tt'~ 1 u by the rule that for 

s e S, t t T t' e T, u e U 

each s e S, u e U, the s , u -th entry (AB) » » = coefficient .A s tB.i „ of the term 

t,t'eT 

— 1 ' — 1 nil /; ' /; 

s it u m ^4ij for which s = s , t = t , u = u . 



1.2.4 TTie Complexity of Matrix Multiplications Realized by Groups 

In the approach we describe, estimates for u> can be derived from certain numerical parameters 
relating to the efficiency with which groups realize matrix multiplications, and also to the 
degrees of their irreducible characters. 

(1) Pseudoexponents a(G), defined by a(G) := log z ' ( - G - ) i/3 |G|, where (n' ,m ,p'^ is a matrix 

tensor of maximal size z (G) = n m p > 1 realized by G, and uniquely determining 

, 3 

a(G). We prove that |G| < z (G) < \G\ 2 , which is equivalent to 2 < a(G) < 3, and that 
a(G) = 3 whenever G is Abelian. The a(G) are measures of the efficiency with which the 
groups G realize or embed matrix multiplication, and the closer a(G) is to 2 the higher 
the embedding efficiency (section J^.2.1). 

(2) Parameters 7(G), defined by 7(G) := inf = d'(G), where d '(G) is any maximal 

7 > 

irreducible character degree of G, for which we can easily prove that 2 < < 
7(G) < 2 log^l^g)) ; where c(G) is the class number of G, and that 2 < 2 log 1 °^| 1 , ) < 
^( G ) < 2 lo g (|G|- G J(G)) ' ifF G is non-Abelian ((section 4.2.2)) 

(3) Sums of powers of irreducible character degrees, D r (G) = d r g , r > 0. Facts from 

g e Irrep(G) 

representation theory are that Dq(G) = c(G), and D2(G) = \G\ (section 3.2.) . 



1.2.5 Relations and Results for the Exponent u 

The four most important relations which we prove using single groups G are the following. 
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(1.1) |G|=fo < £> W (G) 


this is equivalent to 2 ^ to ^ a(G) log| G | D UJ {G) 


(1.2) D r (G) < \G\ ^ G > fl 


real r > 2 


(1.3) (nmp)^ <d!(G) 1 -^ |G|« 


if G realizes a tensor (n,m,p) 


(1.4) u J <a(G)(^^) 


if a(G) < 7(G) 



By applying these relations, we have also been able to derive a number of results about how 
to prove estimates for to using non-Abelian groups. These are listed below. 

Proposition 1.1 to < t < 3 for some t > 2, if there is a non-Abelian finite group G with 
pseudoexponent a(G) and parameter 7(G) such that a(G) < 7(G) and a(G) ^(Qy}a(G) ) — ^- 
An equivalent, but more precise statement is that 00 < t < 3, for some t > 2, if there is a non- 
Abelian finite group G realizing matrix multiplication of maximal size z (G) and with a maximal 
irreducible character degree d (G) such that z (G)s > d (G) and \G\ < d *^( t -2) ■ (Corollary 
4.28) 

Proposition 1.2 If {Gk} is a family of non-Abelian groups such that a (Gk) = = 2 + o(l) ; 
and 7 (Gk) = 7^ = 2 + o(l), and a^ — 2 = o{j k — 2), as k — ► 00, then lo = 2. ( Corollary 4-29) 

Proposition 1.3 Let {Gk} be a family of non-Abelian groups Gk realizing matrix multiplica- 
tions of largest sizes z' k = z '(Gk) and with largest irreducible character degrees d' k = d' k (G). 
Then, (1) 00 = 2 if \G k \ 2 - z k 3 = o(l) and (\G k \ - 1)2 - d k = o(l) such that \G k \ 2 - z k 3 = 
((l^fcl — I) 5 ~~ d'^ as k — > 00. And more generally, (2) to = 2 if \G k \ — ► 00 as k — ► 00 
and there exists a sequence {Ck} of constants Ck for the Gk such that 2 < Ck < \Gk\ — 1, 
\G k \ > Ck (l + c^i), Ck — oo, Ck = o(\G k \), (\G k \ - G fc )5 - d' k = o(l), \G k \* - z* = o(l) 
and \G k \^ - z k * = o ({\G k \ - C k )^ - d' k ^j , as k — ► 00. (Theorem 4.30) 

1.2.6 Realizing Simultaneous, Independent Matrix Multiplications via Groups 

In Chapter 5, we introduce a more general concept of simultaneous triple product property 
(STPP) (also due to Cohn and Umans, [CUKS2005]). To be more precise, a collection 
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{(Si,Ti,Ui)} ie j of triples (S^Tj, E/,) of subsets Si,Ti,Ui C G, of sizes \Si\ = mi, \T\\ = pi, 
\Ui\ = qi respectively, is said to satisfy the simultaneous triple product property (STPP) iff it is 
the case that each triple (Si, Tj, Ui) satisfies the TPP and s^s ■ 1 t'jt k 1 u' k u i 1 = 1q => i = j = k, 
for all s^Sj 1 e Q(Si,Sj), t-t^ e Q(Tj,T k ), u^u^ e Q(U k ,Ui), i,j,k e I. In this case, G is 
said to simultaneously realize the corresponding collection {{mi,Pi, <?j)}j e / of tensors through 
a corresponding collection {(Si,Ti,Ui)} i e j, which is called a collection of simultaneous index 
triples. The importance of STPP is that it describes how a finite group may realize several 
independent matrix multiplications simultaneously such that the total complexity of these sev- 
eral matrix multiplications cannot exceed the complexity of one multiplication in its regular 
group algebra. The first set of important results about u relating to the STPP are summarised 
by the following proposition. 

Proposition 1.4 If {{m,i,pi,qi)} r i=1 is a collection of r tensors simultaneously realized by a 
group G then 

r 

(l)J^ (miPiqi)^ < D W (G) ( part (1) of Corollary 5.2) 

i=i 

and if these tensors are all identical, say, (mi,pi,q,j) = (n,n,n), for all 1 < i < r, then 

u log|G|-log^ (Coroll 53) 

logra 



The most useful types of groups for estimates for u using the STPP seem to be wreath 
product groups H\Sym n , for which we prove that D w (H\Sym n ) < (n!)^ 1 \H\ n (Lemma 5.7). 
Using the latter result, the most general result which we've obtained (Proposition 5.10) in this 
regard involves the wreath product groups H I Sym n where H is Abelian. 



Proposition 1.5 For any n triples Si,TiUi C H of sizes \Si\ = mi, |Tj| = Pi,\Ui\ = qi, 
1 < i < n satisfy the STPP in an Abelian group H , there is a unique number 1 < k n < (re!) 3 of 
triples of permutations, Uj,Tj,Vj e Sym n , 1 < j < k n , such that the k n permuted product triples 

n n n 

\[S aj {i) I Sym n , U.T T .^ I Sym n , J] U v .^ I Sym n , 1 < j < k n , satisfy the STPP in H I Sym n , 

i=l i=l i=l 
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n n 



and such that H I Sym n realizes the square product tensor (n\\\ m,i,n\ Y\pi, n\ Y\ q% ) k n times 

\ i=\ i=\ i=i 

simultaneously, such that 

nlog \ H\ — logn! — logk n 



UJ < 



n 



log ? rrnpiqi 



=1 



1.2.7 Estimates for the Exponent uj 

In Chapter 6, we give several estimates for uj using Abelian groups H or wreath products 
involving them, H I Sym n . 



UJ < 


Group 


Reference 


2.93 


CycH I Sym 2 


section 6.2.2 


2.82 


{Cyc^) xm I Sym 2 ™ 


section 6.2.3 


2.82 




section 6.2.1 



We conclude with the observation that (Cyc* 3 ) xn I Sym^^ (i.e. y(Cyc* 3 ) X ™J x Sym2") 
realizes the product tensor <Vl (n - l) n2 " , 2"! (n - l)™ 2 " , 2 n ! (n - l) n2 ^ some 1 < fc 2 n < 
(2 n !) 3 times simultaneously such that 

2 n log n 3n - log 2 n \ - log fc 2 n 

to *^ . 

2 n nlog (n — 1) 

For example, if k 2 n = (2 n !) 3 then uj < 2 ^"niogin-i) 2 ' * ne l a tter achieving a minimum of 
2.012 for n = 6. In general, for the groups (Cyc„ ) i 1 Sym2^ the closer fon is to (2 n !) , the 
closer uj is to 2.012 (from the upper side). 

It is one of the original suggestions in the thesis that given an Abelian group H with a 
given STPP family {(<Sj, Tj i CZj)}™ =1 it is therefore useful to know the how to choose triples of 
permutations aj,Tj,Vj e Sym n in order that a maximum number 1 < k n < (n!) 3 of triples 

n n n 

]1 S a .^ I Sym n , J] T TjW I Sym n , ]J U Vj(i) I Sym n , 1 < j < k n , satisfy the STPP in H I Sym n . 

i=l i=l i=l 

Using such groups and their triples in this way, the sharpest upper bounds for uj will occur 
where the ratio k n j (n!) 3 is highest. 
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Chapter 2 

Algebraic Complexity of Matrix 
Multiplication 

In section 2. 1 we describe matrix multiplication as a bilinear map describing multiplication in 
matrix algebras, and introduce a certain measure of the complexity of matrix multiplication 
denned in terms of the concept of rank of bilinear map. Then, in section 2.2 we introduce the 
exponent uj as an asymptotic, real-valued measure of complexity, and conclude by describing 
the fundamental relations between the bilinear and the asymptotic measures. 

2.1 Bilinear Complexity of Matrix Multiplication 
2.1.1 Matrix Multiplication as a Bilinear Map 

If U and V are two iiT-spaces of dimensions n and m, respectively, with bases {ui} 1<i<n and 
{vj}i < j <m respectively, then for any third space W, a map <fi : U x V — ► W which satisfies 
the condition 

(f> (k\Ui + K 2 Vi, K 3 U 2 + K4V2) 
= KlK 3 (/>(ui,U 2 ) + KiK4(f>(ui,V2) + ^2^30 , n 2 ) + K 2 K4(f> (v±, V2) 
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for all scalars k±, K2, K3, «4 e if and vectors u±,U2 e J7, ^1,^2 e V", is called a K-bilinear 
map, or simply, a bilinear map, on J7 and F. The map K nxm x K mxp — ► /f nx P describing 
multiplication of n x m by m x p matrices over if is such a bilinear map, which we denote by 
(n, m,p) K . We call the integers n, m,p the components of the map (n, m,p), which is also called 
a tensor, ([BCS1997, p. 361]. 

For a if-space U, the set of all linear forms (functional) / : U — ► K on U , i.e linear maps 
of U into its ground field, forms a if -space U* , equidimensional with U, called its dual space. 
The matrix vector space K nxm has the basis {Eij} i<i< n , where is the n x m matrix with 

l<j<m 

a 1 in its (i,j) th entry and a everywhere else, and the dual space K nxm * has the dual basis 
je^ j 1<i<n where e*j is a map K nxm — ► if which sends any n x m matrix A over if to its 

l<j<m 

(i,j) th entry (A)^. We denote the zero n x m matrix of K nxm by O nxm . 
2.1.2 Rank of Matrix Multiplication 

The set BUk (U, V; W) of all bilinear maps on two If -spaces U and V into a third space W 
also forms a if -space, e.g. (n,m,p) K e Bil K (K nxm , K rnxp ; K nxp ). If U = V = W, we write 
-BiZx (£/") for (U, V; W). For any 4> e BUk (U, V; W), there is a smallest positive integer 
r such that for every pair (u, v) e U x V, <j> (u, v) has the bilinear representation 

r 

(f) ( U , V) = ^f* (it) 5* (v) I0j 
i=l 

where /* e U*,g* e V*,Wi e W correspond to cf), and the sequence of r triples, fl,g\,w\; 
/|,<7|,iU2; .... ; f*,g*,w r is called a bilinear computation for of length r [BCS1997, p. 354]. 
The bilinear complexity or rank 9\ (0) of <p is defined by 

min jr e Z + I (/> (u, v) = J^f* (u) g* (v) w t , {u,v)eUxV^. 

where /* e U* , g* e V* ,W{ e W uniquely correspond to 4>, i.e. 9t(</>) is length r of the shortest 
bilinear computation for [BCS1997, p. 354]. For example, if U = V = W = K™™, where 
Kp*a g is the space of all n x n diagonal matrices over if with pointwise multiplication, then 
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/* = g* = e*,, Wi = En, 1 < i < r, and r = n. In the same way, the rank 91 ((n, m,p}) of the 
tensor (n,m,p), i.e. the rank of n x m by m x p matrix multiplication, is the smallest positive 
integer r such that every product AB e K nxp of an n x m matrix A e K nxm and an m x p 
matrix B e K mxp has the bilinear representation 

r 

(n,m,p) (A, B) = AB = ^/* (A) 5 * (5) Q 

i=l 

where /* e K« xm *, ^ £ K mx P * ^ c . £ r x Pj 1 < i < r. For example, 9t(0) = n for any 
e ^SiLff)' e -S- ^ (( n ' n i n )z)ia( 7 ) = n > where {n,n,n) Diag is the multiplication map 

ofnxti diagonal matrices.. For example, if K n is the n dimensional space of all n-tuples 
over K, with a pointwise multiplication map (n) : K n x K n — ► K n of rank 9t((n)) = (n) 
then 91(0) = n for any <p e BUk (K n ) if </> =x (ra). This shows that 9t((n, n, n)) > n, 
because K n =k K^ag — K K nxn . Another property of tensors (n,m,p) is invariance under 
permutations of their components, [BCS1997, pp. 358-359]. 



Proposition 2.1 £H((n, m,p)) = 9\ ((// (n) , fx (m) , fx (p))), for any permutation \x e Sym^. 

For bilinear maps <\> e BUk (U, V; W) and 4> e BUk (u' , V"'; VF'^ , is said to be a restriction 
of , and we write (f> <k 4> , if there exist linear maps (if-space homomorphisms) a : £7 — ► 
t/,/3 : F — ► V' , j : W' — ► W such that <j>{u,v) = 7' o / o (a x /3) (u, v), for all (u,v) e 
U xV. In this regard, a basic result is the following. 

Proposition 2.2 For any bilinear maps 4> e BUk (U, V; W) and <p e BUk (u' , V' ; W'^j , 4> <K 
4 implies < SK (V) . 

Proof. For bilinear maps e .BiZx (£7, V; W) and 0' e (if' , V' ; W'^j with ranks 9t (0) = 
r and 9\ = r', respectively, the assumption that cf> <k 4> \ by definition, implies there are 
linear maps a : U — ► U' ,(3 :V — ► V', 7' '■ W' — ► W such that (f> (u, v) = 7' ' o<p' o(a x (3) (u, v), 
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for all (u, v ) e U x V. By these maps, for an arbitrary (u,v) e U x V 



7 o o (a x (3) (u, v) 
= 7(/((«x/J)(v))) 

j'=i 

r 

= w f/* («) ( + ) 

= <t>{u,v), 

where /y, e 17*, e V*, w-< e W, 1 < j < r , and f*,g'*, Wj \ f* e U'*,g* e V*,Wj e 
W' , 1 < j < r is the minimal bilinear computation for <fi . Since we must have <fi(u,v) = 

r 

Y^ft ( u ) 9i ( v ) w ii where f*,g*,wf, f* e U*,g* e V*,Wi e W, 1 < i < r is the minimal bilinear 
i=i 

computation for the minimum number r of terms which can occur in sums of the type (+) 
must be < r , i.e. r < r . ■ 

Two bilinear maps <f> e BUk (U, V; W) and <fi' e BUk (u' , V' ; W'^j are said to be isomorphic 
if there exist isomorphisms a : U — ► U' , j3 : V — ► V' , and 7 : W — ► W' such that 
70^ = <p o (a x (3), [BCS1997, p. 355]. The following proposition is a basic result for 
isomorphism of bilinear maps. 



Corollary 2.3 For any bilinear maps 4> e BUk (U, V; W) and <f> e BUk (u' , V' ; W'^j , 4> —K 4 
implies <f> <k <f> and <p <k <f>, in which case also 9\ (</3) = 91 

Proof. Consequence of Proposition 2.2. ■ 

As an example of restrictions, consider the matrix spaces U = K nxm , V = K mxp , W = 
K nxp and U' = K n ' ' xrn ' , V = K m ' xp , W' = K n ' xp ' , where n < n , m < m , p < p , 
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and (f> = (n,m,p) and <f> = (n',m',p^. Then, there is a natural, injective linear map 
a . j^nxm — ^ j^n xm ^jgjj embeds an n x m matrix A into K n xm as an n x m matrix A 

having A as an n x m block in its top-left corner and O's everywhere else. There are analogous 

it tt 
injective linear embedding maps j3 : K mxp — ► K m xp and 7 : K nxp — ► K n xp for K rnxp 

and K nxp , respectively. The product map a x (3 : K nxm x K mxp — ► if tt ' xm ' x K m ' xp will 

be injective and there will be a natural surjective linear map 7 : K n xp — ► j^nxp w j 1 j c ] 1 j s 

the identity map on left upper n x p blocks of n x p matrices. Hence we have a restriction 

(n,m,p) = 7' o (n ,m ,p'^ o (a x (3) of (n ,m ,p'^ to (n,m,p). Informally, we have proved 

the following [BCS1997, p. 357 & 362]. 



Proposition 2.4 Ifn<n,m<m,p<p then (n, m,p) <k (n ,m ,p j , and ((n, m,p)) < 
9i ((ri , m' ,p'^j . 

If J7 and V are two algebras of dimensions n and m, respectively, then their direct sum U®V 
is an n + m dimensional K-space which has as a basis the union of the bases {(ui,0)} 1<i<n 
and {(0,Vj)} 1< j <rn where {ui} 1<i<n and {vj} 1< j <m are the bases of U and V respectively, 
and their Kronecker product U © V is an nm dimensional K-space of sums of dyads u © v, 
u e U, v e V, which has as a basis {ui © Vj} \<i< n . If U and V are two algebras of di- 

l<j<m 

mensions n and m, respectively, then U © V becomes an nm-dimensional algebra with mul- 



tiplication with the property that (u © v) yu © v j = yuu ®vvj for any pair of elements 
u © v , u © v e U © V. For bilinear maps <ft e BUk (U, V; W) and (j> e BUk (if , V' ; W'^j , 
their direct sum <f> © f e Bil K (u © if, V © V ; W © W'^j and Kronecker product <p ® f e 
BUk (u ®U' ,V ®V' ;W ® W'^j can be defined and satisfy 9t (<f> © < $H (0) + <H (V ) and 
9t ® < 9t (0) 9t (V ) [BCS1997, p. 360]. An important fact here is that to each bilinear 
map 4> e Bil (U, V; W) there exists one and only one unique tensor e U* © V* © W, called 
the structural tensor of (/), [BCS1997, p. 358], i.e. Bil (U, V; W) ^ K U* © V* © W. Therefore, 
the isomorphism of two bilinear maps, as described before Corollary 2.3, is equivalent to the 
isomorphism of their corresponding structural tensors, and therefore, the rank of a bilinear map 
is equal to the rank of its structural tensor. 

For tensors we have an important but easily provable result [BCS1997, pp. 360-361]. 
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Proposition 2.5 For tensors (n,m,p) and (n ,m ,p ' ^ , 

(1) (n, m, p) (& (n , m , p ) < k (n + n , m + m , p + p 

and 



(2) (n, m, p) (g) (n , m , p ^) (|nn , mm , pp ^ 



Direct sums of matrix tensors describe block diagonal matrix multiplication, and Kronecker 
products of tensors describe block matrix multiplication. A basic result which we will use is 
the following, as defined in [BCS1997] just before Def. (14.18). 



Proposition 2.6 For tensors (n,m,p) and (^n ,m ,p 

(1) %\ (^(n, m,p) © (n , m ,p ^ < %\ ((n, m,p)) + ^(n , m ,p ^ 

anc? 

(2) 9\ (^(n,m,p) ® (^n ,m ,p^ < 9i ((n, m, p)) • 9i , m , p ^ . 
2.1.3 Matrix Algebras 

A K-algebra A is a vector space A defined over a field K, together with a vector multiplication 
map <fi A : A x A — > A which is bilinear on A, in the sense described above, with a unique 
unit 1a which coincides with the unit of A as a multiplicative monoid. (Here, by definition 
an algebra A has a unit.) The dimension of the algebra A is defined to be its dimension as a 
vector space. We denote the unit of A by 1a- A is called associative iff 4>a is associative, and 
commutative iff <Pa is commutative. The rank $\ (A) of A is defined to be the rank (<Pa) °f 
(j>A, and is a bilinear measure of the multiplicative complexity in A. For example, the matrix 
space K nxm is a matrix K-algebra iff n = m. x nxn is an n 2 dimensional matrix JT-algebra 
with a bilinear map (n, n, n) describing multiplication of n x n by n x n matrices. We say that 
n is the order of the algebra K nxn . 
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If A and B are two K-algebras then a linear map ip : A — ► B which carries vector 
multiplication in A onto vector multiplication in B is called an algebra homomorphism, or 
simply, an algebra morphism, between A and B, i.e. if for any a, a e A, if (a, a) = <p(a) <p (a'^J , 
and ip (1a) = Ifi- A simple example is the inclusion homomorphism X2 of the algebra K^ 2 g of 
all diagonal 2x2 matrices over K into the algebra K 2x2 of all 2 x 2 matrices. <p is an algebra 
isomorphism A =k B iff </> A 0b (=> 9*(<£a) = 9*(0b))» [BCS1997, p. 356]. For example, 
(2,2,2) DM9 <k (2,2,2) and 9* ((2,2,2) D .J = 2 < JK«2,2,2», and 9* ((2, 2, 2) D .J = 2 = 
91 ((2)) because K 2x2 g ^ K K 2 , where i^ 2 < K K 2x2 . In general, for any n-dimensional algebra 
A it is the case that 91 (<f> A ) = n iff A ^ K K n , or equivalently iff <f> A ^ K (n), [BCS1997, p. 364]. 

The following is a general result for matrix algebras. 



Proposition 2.7 For positive integers n, n , 

(1) if n < n then (n, n, n) <k (n ,n , n ) and 9t ((n, n, n)) < 9t ( (n , n , n 
and 

(2) (n, n, n) =x , n , n ^ and 91 ((n, n, n)) = 9^ ^(n , n , n ^ iff n = n . 



If {K n » xn »} is a finite collection of matrix algebras K niXrii of orders rii, then ©_fC n » xn » 

i 

is a direct sum matrix algebra of order ^ n «> i n which multiplication is block diagonal and 



is described by the direct sum tensor ® (rii, rii, rii) = ( ^nj,^nj,^rij ); and (g)K niXrii is a 

* \ i i i I % 

Kronecker product matrix algebra of order \\ni, i n which multiplication is described by the 



Kronecker product tensor ® (rii, rii, rii) = ( n n «ill n i>n n « /■ Using Proposition 2.6, we have 
the following result. 



tit 



Proposition 2.8 For a finite set of positive integers rii 

(l) 9t I e {ni, m, Hi) j < ^9i ((ni, in, m)) 
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and 

(2) 9t ^<g) (ni,ni,nj)^ < (( n «> • 

When rij = n, for 1 < i < r, we shall denote by (n, n, n)® r the r-fold Kronecker product 
<g) (n,n,n). By part (2) of Proposition 2.5 {n,n, n)® r = (n r ,n r ,n r ) and 91 ((n, n, n)® r ) = 

l<i<r 

9l((n r ,n r ,n r )). The following is a relevant proposition. 

Proposition 2.9 For positive integers r,n, *K ((n r , n r , n r )) < 9\((n,n,n)) r . 



2.1.4 The Rank of 2 x 2 Matrix Multiplication is at most 7 



We explain here Strassen's result that the rank of 2 x 2 matrix multiplication is at most 7. If 



A 



An A 12 
A21 A22 



and B 



B\i B\2 
B21 B22 



are given 2x2 matrices, then by the formulas 



Pi = (A u + A22) (B u + B22) , 

P 2 = {A21 + A 2 2)B ll , 

P3 = An (B12 — B22) , 

Pa = (-An + A21) (Bu + S12), 

P5 = (A u + A u ) B 22 , 

P 6 = A 22 {-Bu + B21) , 

Pj = (A12 - A 22 ) (B 2 i + B 22 ) 



we will be able to recover their product AB = C 



C11 C12 
C21 C22 



by the formulas 



Cu = Pi + P e -P 5 + P 7 , 

Cl2 = P3 + Pbi 

C*21 = ^2 + -Ffe; 

C 22 = P 1 -P 2 + P 3+ P 4 , 
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using a total of 7 = # {Pi, P2, P3, P4, P5, P6> P7} multiplications and 18 additions/subtractions 
[PAN1984, p. 394]. 



If we then define 7 paired linear forms f*,g* e K 2x2 * , 1 < i < 7, by 





= A n 


+ A 22 


91(B) 


= B n 


+ B 22 




= A 21 


+ A 22 


9l{B) 


= B U 






= A n 




9UB) 


= B\ 2 


— B 22 


tt(A) 


= -A 


Ll + A 21 


9t(B) 


= B U 


+ B 12 


m*) 


= A U 


+ A 12 


9l(B) 


= B 22 






= A 22 




9l(B) 


= -B 


Ll + B 2 i 




= A 12 


-A 22 


9* 7 (B) 


= B 2 \ 


+ B 22 



then there are matrices e K 2x2 , 1 < i < 7, such that 

7 

AB = J2ft(A)9*(B)Ci 

hence 91 ((2, 2, 2, )) < 7 [BCS1997, pp. 10-13]. We state this formally, for future reference. 
Proposition 2.10 9t«2,2,2,)) < 7. 



In general, if n = 2m, this algorithm allows us to multiply 2m x 2m matrices with 7 
multiplications and 18 additions/subtractions of m x m matrices, for m > 1. We define an 
integer function Tk (n) by 

(2.1) Tk (n) := min two n x n matrices can be multiplied using t multiplications, additions, 
or subtractions. 

If n is some power 2 m of 2, then we can partition two 2 m x 2 m matrices into four 2 m_1 x 2 m ~ 1 
blocks each, and view these blocks as inputs to the original algorithm, and by a recursive 
application of this procedure we obtain for Tk (n) the following recursion formula [BCS1997, 
pp. 12-13]. 
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(2.2) T K {n) < 7T K + 18 {\nf . 

In 1971, Winograd proved a stronger result that 9t((2, 2, 2, )) = 7, [WIN1971]. 



2.2 Asymptotic Complexity of Matrix Multiplication 

Here we introduce the exponent uj describing the asymptotic complexity of matrix multiplica- 
tion, including Strassen's estimate of oj < 2.81, and conclude with some fundamental relations 
between oj and the ranks of matrix tensors, which we shall use later in our analysis and estimates 
of uj in Chapter 6. 

2.2.1 The Exponent of Matrix Multiplication 

We denote by Mk (n) the total number of arithmetical operations { x , +, — } needed to multiply 
n x n matrices over K. This is defined more formally as: 



where K[X, Y] is the ring of bivariate polynomials over K, and the expression on the right 
is an exact measure of the total number tot of arithmetical operations {x,+,— } needed to 
multiply two n x n matrices of a given set of indeterminates Xij, Yjk 6 K, 1 < i, j, k < n, over 
K without divisions [BCS1997, p. 108, p. 126, p. 375]. 

The exponent of matrix multiplication over K is the real number uj (K) > defined by 



The notation oj (K) is intended to indicate a possible dependency on the ground field K. 
It has been proved that uj (K) is unchanged if we replace K by any algebraic extension K 



(2.3) M K (n) := L 



'K[X,Y\ 



(n) := L 




(2.4) uj{K) := mi{h e R + | M K (n) = O (n h ) , n — > oo}. 
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[BCS1997, p. 383]. It has also been proved that uj (K) is determined only by the characteristic 
Char K of K, such that oj(K) = u(Q) if Char K = 0, and oj(K) = w(Z p ) otherwise, where 
Z p is the finite field of integers modulo a prime p, of characteristic p, [PAN 1984].. Since Char 
C = Char R = Char Q = 0, this means that u(C) = u (R) = w(Q). In this chapter, we 
shall continue to indicate the ground field dependency in writing uj (K), but in later chapters 
we shall drop this formalism and simply write uj, since our concern will be with complex matrix 
multiplication, which is general enough for most purposes. 

Returning to Mk (n), by the standard algorithm for n x n matrix multiplication, the n 2 
entries Cik of an n x n matrix product C = AB are given by the formula Cik = Yl ^ijBjk, 

l<j<n 

for all 1 < i, k < n. In using the standard algorithm, we will be using n 3 multiplications, and 
n 3 — n 2 additions of the resulting products, which yields an upper estimate Mk (n) = 2n 3 — n 2 < 
2n 3 = 0(n 3 ), i.e. Mk (n) < C'n 3 for the constant C' = 2, and implies an upper bound of 3 
for uj [BCS1997, p. 375]. For the lower bound, we note that since the product of two n x n 
matrices consists of n 2 entries, one needs to perform a total number of operations which is at 
least some constant C > 1 multiple of the n 2 entries, which we denote by M^(n) = S7(n 2 ), 
and is equivalent to a lower bound of 2 for uj [BCS1997, p. 375]. (Our focus will be on the 
upper bounds for Mk (n) since we are interested in worst case complexity.) Informally, we 
have proved the following elementary result. 

Proposition 2.11 For every field K, (1) 2 < uj (K) < 3, and (2) uj (K) = h e [2,3] iff 
Q(n h+€ ) = Mk {n) = O (n /l+e ), where h is uniquely minimal for any given degree of precision 
e > 0. 

The connection between the exponent uj and the concept of bilinear rank is established by 
the following important proposition, [BCS1997, pp. 376-377]. 

Proposition 2.12 For every field K 

uj (K) = inf {h e R+ | m ((n, n, n)) = O (n h ) , n — ► oo) . 
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This means for any given degree of precision e > 0, with respect to a given field K, there 
exists a constant Ck,e > 1> independent of n, such that *K((n,n, n)) < C^n^^'^ for all 
n. It is conjectured that a; (C) = 2, [CU2003]. Henceforth, uj shall denote c<j (C) and in the 
concluding sections we shall describe some important relations between uj and the concept of 
tensor rank, introduced earlier, which describe the conditions for realizing estimates of uj of 
varying degrees of sharpness. 

2.2.2 Relations between the Rank of Matrix Multiplication and the Expo- 



Taking tensor product powers in the estimate SH((2,2, 2)) < 7 (Proposition 2.10) we have, by 
part (2) of Proposition 2.9, 



Since for all positive integers n > 2, n < 2 r io S2 "1 = n + e n , where e n > is a residual depending 
on ra, and [•] denotes the ceiling function for real numbers, using Proposition 2.9 again we have 



< 9*((2,2,2)) riog2nl 

< 7r io g2«i 

< 7n lo ^ J « 7n 2 - 807 . 

By Proposition 2.12 this gives Strassen's estimate uj < 2.81 [STR1969, pp. 354-356]. The best 



estimate of u> is Coppersmith and Winograd's result that uj < 2.38 [CW1990, p. 251]. 

Assume that £H((n, m,p)) < s for positive integers n, m, p, and s. By Proposition 2.1 and 
part (2) of Proposition 2.5, (nmp,nmp,nmp) = (n,m,p) (g) (m,p,n) (g) (p,n,m). Then, we see 



nent uo 



fH((2 ra ,2 n ,2 n )) =m ((2,2,2) ® n ) < m ((2, 2, 2)) n < 7 n . 
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that 



OK ((nmp, nmp, nmp)) 
= 9\({n,m,p) <8) {m,p,n) <8> {p,n,m)) 

< 0\[(n,m,p) m ^ 

< %X((n,m,p)f 

< s 3 . 

i.e. that (nmpf < s 3 , which is equivalent to (nmp)~ < s. We have proved the following result, 
which we shall repeatedly use later [BCS1997, p. 380]. Since £H((n, m,p)) is, by definition, a 
positive integer, and £H((n,m,p)) < 0K((n,m,p)), we have proved the following. 



Proposition 2.13 (nmp) 3 < 0\((n,m,p)) for any positive integers n,m,p. 

This is equivalent tow < lo g^((". m .p)) f or an y positive integers n, m, p, a consequence which 

log(nmp) ' 

occurs in a group-theoretic context as shown in Chapter 4- Informally, we can understand nmp 
to be "size" of n x mby m x p matrix multiplication, and (nmp) 3 to be the (geometric) mean 
of this size. The above proposition has as a generalization the following statement. 

Proposition 2.14 YK n i m iPi)^ < ^ ^© ( n «; rrii,Pi)^J , for any finite set of positive integer 
triples ni, mi, pi. 



This is a formulation in terms of ordinary rank 9^ of Schonhage's asymptotic direct sum 
inequality involving the related but approximative concept of border rank fK, which we shall 
not discuss further [BCS1997, p. 380]. In essence, Proposition 2.14 means that the complexity 
of several, simultaneous independent matrix multiplications is at least the sum of the mean 
sizes of the multiplications to the power uj, a consequence which occurs in a group-theoretic 
context as shown in Chapter 5. 



24 



Chapter 3 



Basic Representation Theory 



We start with some basic theory of representations and character theory of finite groups, focus- 
ing in particular on various relations and estimates for sums of powers of the distinct irreducible 
group character degrees, which will be important in the central analysis in Chapter 4- Then we 
proceed to describe basic facts about multiplicative complexity in regular group algebras, and 
conclude with an outline of the discrete Fourier transforms for groups and their computational 
complexities. 

3.1 Basic Representation Theory and Character Theory of Fi- 
nite Groups 

3.1.1 Representations, CG-Modules and Characters 

In this thesis, a (finite-dimensional) representation tt of a finite group G is defined as a group 
homomorphism tt : G — ► GL(V), where V is a finite-dimensional, complex vector space, and 
where GL(V) is the group of all linear operators mapping V to itself. In particular, when 
V = C n then GL (V) = GL (n, C), the group of all invertible n x n complex matrices, and tt is 
called a matrix representation of G. For example, G always has the trivial representation i on 
V, defined by g — ► 1gl(v)> whenever g e G, where Iqlcv) 1S the identity automorphism of V. 
If 7r is a representation of G we will call V the target space of tt, and define the dimension of 

25 



tt to be the dimension of V, i.e. Dim tt := Dim V. For each g e G, tt (g) is an automorphism 
V — > V of V, and we note that tt satisfies Tr(gh) = ir(g)ir(h), vr^" 1 ) = (7r(g)) _1 , for all g,h e G, 
and that in particular, tt(1g) = 1gl(v)i the trivial automorphism of V. A representation of G, 
the so-called (right) regular representation, exists when V = C G = {/ | / : G — ► C}, the |G|- 
dimensional, associative C-algebra of all complex-valued maps / : G — ► C on G, with standard 
basis Bg = {e g \ e g e C G , e g (h) = 5 g ^, h e G} of the |G| indicator maps e g < — ► g e G. C G can 

be identified with the set CG = < J2 fg9 I / e ^ G i fid) = fg( of all formal linear sums of group 

[geG J 

elements with coefficients as their /-values, for each / e C G . CG constitutes a |G|-dimensional 
vector space over C and it is a C-algebra called the regular group algebra of G, admitting as 
basis elements the elements of G itself, yielding the regular basis. The endomorphisms / = 
Yl fn'9 l— ^ df := Yl f ' \ 99)i f e < ^ ( -^' ar bitrary fixed geG, describe permutation left- 

geG geG 

actions on regular basis components of / e CG for elements geG via their uniquely associated 
permutations fj, g e Sym\G\, and have unique associated permutation matrices [g] G e GL(\G\ ,C). 
The regular representation of G, denoted by p €G , is the mapping g i — ► [g] G = Pccid)' 9 e G. 

Let 7r be a representation of G on a vector space V. If W is a subspace of V which 
is invariant under the automorphisms ir(g), i.e. n(g)(W) C W, for all geG, then W is 
called 7r -invariant. The restriction tt j W of tt to a 7r-invariant subspace W of V produces a 
representation p of G on called a subrepresentation of 7r, which can be called a component 
(representation) of tt, and conversely, every subrepresentation p of a representation 7r of G on V 
is the restriction tt j of 7r to some 7r-invariant subspace W of V depending on p: p is given by 
p(g)(w) = Tr(g)(w), for all 5 e G, tt; e W. It follows that the dimension of a subrepresentation of 
a representation of G cannot exceed the dimension of the representation, tt is called irreducible 
iff it contains no nontrivial subrepresentations, otherwise it is called reducible. G admits 
always has the trivial 1-dimensional irreducible representation l\, as defined by g — ► (1), 
and conversely any 1-dimensional representation is irreducible; equivalently, the dimension of 
a reducible representation is at least 2. If p is any other representation of G on a vector space 
W , then tt and p are called equivalent (notation tt ~ p) iff there is a vector space isomorphism 
T :V = W such that T(gv) := T(Tr(g)(v)) = p{g)T(v) =: gT(v), for all g e G, v e V. Otherwise, 
i.e. if such a T does not exist for tt and p, they are called inequivalent, and we denote this by 
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tt oo p. Equivalence of representations is an equivalence relation. If g and q are two irreducible 
representations of G then we define the delta quantity 5 es as 5 es = 1 iff g ~ q and S QS = iff 

Q to <J. 

Given a representation 7r of G on a vector space V, there is a naturally defined multiplication 
map G xV — > V describing left-action (g, v) i — > gv := tt (g) v of G on V, which is associative: 
(gh)(v) = g(hv); has a natural identity: Iqv = v for all v e V; is invertible: v = g~ 1 {gv) = 
g(g~ 1 v); is homogenous with respect to scalar multiples of vectors: g(Xv) = X(gv); and is 
right-linear with respect to CG-multiplication: g(v + v) = gv + gv ; for all elements g,h e 
G, vectors v, v e V, scalars A e C. The space V under this multiplication is called a CG- 
module, and its dimension is its dimension as a vector space. A special kind of CG-module, 
called the regular CG-module, occurs when V = CG = < ^g9 I A 9 e C > , the regular group 

[geG J 

algebra of G, discussed above. A subspace W of V is called a CG-submodule of V iff it is 
closed under the map G xV — ► V via it. A CG-submodule W of V under the representation 
7r always corresponds to some subrepresentation p of it. V and the zero subspace {Oy} 
always form trivial CG-submodules of V, and V is an irreducible CG-module iff it contains no 
nontrivial CG-submodules. Two CG-modules V and W, corresponding to representations it 
and p, respectively, of G, are called equivalent iff tt is equivalent to p, otherwise they are called 
inequivalent. 

Given a representation tt of G on a space V, the character x n of tt (also, the character of V as 
a CG-module) stands for the map G — ► C defined by Xwid) := ^ r (^(fiO)) 9 e G, where Tr(-) is 
the trace map for operators. The degree d^ of the character \-k ls defined to be the dimension of 
its underlying representation tt, i.e. d n := XkO-g) = ^(^(Ig)) = Tr{lQL(y)) = Dim tt = Dim 
V. For example, the character x L1 of the trivial irreducible representation t\ is defined by 
g i — ► 1, g e G. The set of all characters Xtt °f C is denoted by G. Characters of degree 1 
are called linear. A character Xn ^ s sa, id to be irreducible iff its underlying representation tt 
is irreducible, otherwise it is said to be reducible. All linear characters are irreducible. The 
characters Xw an d X P of equivalent representations tt and p, respectively, are the same, and, 
conversely, tt and p are equivalent if x-k = X P - The character of the regular representation 
p CG of G, called the regular character of G, denoted by Xcg> * s the map G — ► C defined by 
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g i — ► Tr(xcc(9))^ 9 e G. Observe that Xcg takes the value |G| if g = Iq, and otherwise. 
It holds that d XcG = \G\. We define the inner product of two characters Xn and x P of G by 

3.1.2 Canonical Decompositions for Regular Representations, CG-Modules, 
and Characters 

A representation it of G is called completely reducible iff its target CG-module V is the direct 
sum V = © i?^ of a finite number of irreducible CG-modules R Sn , in which case 

irreducible 

7r is the direct sum of a finite number of irreducible representations g n of G, occuring with 
multiplicity l W)g = (x w , g n ) > 0, called the irreducible components of tt, of dimensions d e ^. The 
following is a fundamental theorem in this regard [SER1977]. 

Theorem 3.1 (Maschke) Every finite- dimensional representation of a finite group is com- 
pletely reducible. 

The character x% of vr is said to completely reducible iff ir is completely reducible, and will 
take the form x n = Yl L , and will have degree d n = d QiT , which is, by 

irreducible irreducible 

definition, the dimension of n and of V. 

The following theorem is crucial here [HUP1998], [SER1977]. 

Theorem 3.2 (Frobenius) If G is a finite group then (1) the number of its distinct irre- 
ducible representations g is equal to the number of its distinct conjugacy classes, denoted by 
c(G), which is called its class number. (2) The characters x e of the irreducible representations 
g form an orthonormal basis o/CG, i.e. (xo>X?) = $es> f or distinct irreducible representations 
g and (3) An arbitrary representation it of G, or its target CG-module V w , is irreducible iff 
its character x w satisfies (XtpXtt) = 1 - ( 4 ) |x e (s)| < |x e (lc)| = d e , g e G, for any irreducible 
character x e of G. 
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There are exactly c(G) distinct irreducible representations g upto equivalence, c(G) distinct 
irreducible CG-modules R g upto equivalence, and c(G) distinct irreducible characters of G upto 
equivalence. The collections of these are denoted by Irrep(G), IrrcG{G), Irr(G), respectively. 
It holds that for any g, q e Irrep(G), x ? ) = S e ^. We note the following result, [HUP1998]. 

Theorem 3.3 {x CG , X e ) = X b 0-g) = d e , for each x e e Irr(G). 

{XcGiXq) i s the multiplicity of an g e Irrep{G) in PcG> which we denote by Icg,q, the 

above result states that every g e Irrep(G) occurs in the regular representation p CG exactly 

lcG,e = Dim g = d g number of times, where Icg,q > 1, since d e > 1. This means, equivalently, 

that every distinct irreducible CG-module R e e IrrcciG), and distinct irreducible character 

X e e Irr(G), occur in CG and Xcg-> respectively, all occur with positive multiplicity equal to 

Icg,q = d g . The Acg> ^G, and Xcg decompose into a direct sum of isotypic components 
'„ ) f d e " \ ( d e \ 

g | g e Irrep(G) > , | © R e \ g e Irrep(G) f , and <j © x e I £• e Irrep{G) f respectively, 



in the following way: 



(3.1) p CG = © d e g= © © q, 

g e Irrep(G) g e Irrep(G) i e =l 



(3.2) CG= © d e R e = © © R, 

g e Irrep(G) Q e Irrep(G) i e =l 



Up 

(3-3) xcg = £ d eX ff = £ Ex t - 

p e Irrep(G) Q e Irrep(G)ig=l 

If we put g?cg = -t^m p CG = Dim CG = Xcg(1g)> then we get: 
(3.4) d CG = \G\= £ *cG,*d ff = £ 4- 

dp e cd(G) d e e cd(G) 

This shows that c£; < |G|, for any g e Irrep(G). 



29 



3.1.3 Induced and Restricted Representations, CG -Modules, and Charac- 
ters 



A representation it of a group G, with target CG-module V n and character x-w, is said to be 
an induction of a representation 9 of a subgroup H < G if V n = © VF K , where G/H 

k e G/H 

lei 

stands for the set of [G : H] = j^j distinct left G-cosets k = s K H of -ff with the s K e G being 
their distinct coset representatives, W\ G = W is a i?es^7r-invariant subspace of F such that 
is the representation 9 : H — ► GL(Dim W,C); {W K } K e G / H is the set of [G : H] distinct, 
Dim VF-dimensional subspaces of V n given by W K = tt(s k )(W), k e G/H [SER1977]. In 
this case, every v e V w has the form Yl w K ; ir is the direct sum n = © 9 K of 

K e G/H, w K eW K K £ G/H 

the subrepresentations 9 K of G on the components W K of V n of the form g i — > [g] K (w K ), k 
e G/H, [g] K e GL(Dim W K ,C); it is said to be induced by 9 and denoted by it = Ind H 9; 
W becomes a CG- module Wg and a CG-submodule of V n ; V w is of dimension [G : H] ■ Dim 
Wg and is said to be induced by Wg and denoted by V w = Ind H Wg. Ind G I 9 will have the 
canonical decomposition © hndPe o ' ^ s character Xi n d G e w ^ n have the decomposition 

q e Irrep(G) H H 

Xind%e = E l indGe, e X Q , and dimension d Ind a e = £ l Ind ag ye d e = [G : H] ■ Dim 

q e Irrep(G) Q t Irrep(G) 

Wg = l jj^dg, where l Ind a 0je = (xi n d%e> X e ) are the multiplicities of the g e Irrep(G) in Ind H 9, 
not all simultaneously equal to [SER1977]. The following proposition summarizes some 
elementary properties of dimensions of induced representations. 



Proposition 3.4 For any representation 9 of a subgroup H < G: (1) d Ind ag = \jj\dg; for any 
g e Irrep{G), (2) d e | d Ind c e ; (3) d e = d Ind a e iff l Ind a 0s = 5^ for all q e Irrep(G), i.e. iff 
Ind H 9 is an irreducible representation of G equivalent to (or coinciding with) exactly one g e 
Irrep(G). 



A representation £ of a subgroup H < G is said to be the restriction of a representation 
7r of G if = Tr(h) for all h e H, and this is denoted by £ = Res H ir, in which case the 
target CG-module U% of £ is said to be a restriction of the CG-module V n of ir denoted by 

= Res H V n [SER1977]. Res H n will have the canonical decomposition © lR es a ird'$i 

-de Irrep(H) H ' 
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E l Re8%«,6X4, and 1* wil1 



1 Result, V = (Xitesg^Xtf) &re 



the nonnegative multiplicities of the d e Irrep(H) in Res^ir, not all simultaneously equal to 0. 
The following proposition summarizes some elementary properties of dimensions of restricted 
representations. 

Proposition 3.5 For any representation n of G > H , (1) d n = d Res c w ; for any # e Irrep(H), 
(2) d. d < d w ifl Res a w ^ > 0; (3) d$ = d w iffl Res G w ^ = 5^ for all cp e Irrep(H), i.e. iff Result 
is an irreducible representation of H equivalent to (coinciding with) exactly one $ e Irrep(H). 

The following is a famous theorem of Frobenius describing a reciprocity between induction 
and restriction of irreducible representations. 

Theorem 3.6 (Frobenius) For a subgroup H < G, and any •& e Irrep(H) and g e Irrep(G), 

^Res%g,-d = ^Q,Ind%d- 

This is called the Frobenius reciprocity law, and in this thesis is useful in deriving information 
about size estimates relating to the dimensions of the distinct irreducible representations of 
groups. 

3.1.4 Irreducible Character Degrees 

Henceforth, let us denote by cd(G) the set of degrees of the distinct irreducible characters of a 
finite group G. Formally: 



We call cd(G) the character degree set of G, where we know |cd(G)| = \Irrep(G)\ = c(G) 
holds. The following is a fundamental theorem about irreducible character degrees [HUP1998]. 



(3.5) cd{G) := {d e = XgO-G) I X Q e Irr{G), g e Irrep{G)}. 
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Theorem 3.7 For any d e e cd{G), (1) d e divides [G : A] where [G : A] is the index of any 
maximal Abelian normal subgroup A of G (ltd), (2) d g divides [G : Z{G)\, where Z(G) is the 
centre of G, and (3) d e divides \G\. 

(2) is a consequence of (1) since if g is irreducible, then d e must divide [G : Z{G)\ where 
Z(G) < A for some maximal Abelian normal subgroup A of G. (3) is a consequence of (2) since 
if q is irreducible then d e \[G : Z(G)] by (2) and therefore d Q \ \G\ = [G : Z(G)] [Z(G) : 1 G ]. 

Let us consider the irreducible character degrees of finite Abelian groups. Until section 
3.1.5 G will be a finite Abelian group. Then every conjugacy class g G of every element g e G 
contains only g as its element, and therefore, there are in G exactly as many distinct conjugacy 
classes as there are elements, i.e. \cd(G)\ = c(G) = \G\. Also, Z(G) = G, [G : Z(G)\ = 1, 
and by Theorem 3.7, for any d e e cd{G), d e \ [G : G] = 1, which means that d e = 1, i.e. 
the dimension of every irreducible representation and every irreducible CG-module, and the 
degree of every irreducible character, of a finite Abelian group G is 1. Thus, the dimension 
d n of an arbitrary representation ir of G, and of its target CG-module V w , is given by d w = 

E (x„,X e )d e = E (Xiv,Xq) = E 1 tt,q, i-e. the sum of the multiplicities 

q t Irrep(G) Q e Irrep(G) Q e Irrep(G) 

of the irreducible components of it. For each g e Irrep(G), and a given g e G, the matrix g(g) 
of g at g will be a 1 x 1 matrix given by (Xo(g)), and its character x s e Irr{G) will have an 
inverse Xg \ defined by x s 1 (s) = X e {g' 1 ) = X e (g), so that Xg 1 = X^; the character set G 
will then form, under pointwise multiplication, a multiplicative Abelian group isomorphic to G, 
called its dual or character group. 

3.1.5 Estimates for Sums of Powers of Irreducible Character Degrees 

We derive here a number of estimates relating to sums of powers of irreducible character degrees 
of a finite group G, for which we introduce a map D r (G) : R + — ► M + defined by: 

(3.6)D r {G)= E d r e = E d£ = E X,(l G ) r , r > 1. 

dp e cd(G) g e Irrep(G) x e e Irr(G) 
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D r (G) records the sum of the r th powers of the distinct irreducible character degrees of 
G. For r = 0, D (G) = c(G). For t > the t th power of D r (G) is given by D r (Gf = 

(Yl d r Q \ , r > 1, and we define D r (G)° := 1. For r = 2, t = 1, (3.6) occurs as the case: 
d e e cd{G) J 

(3.7) D 2 (G)= £ 4 = |G|= XCG (1)- 

c( e e cd(G) 

Every nontrivial group G has at least two distinct irreducible characters, each of degree 
> 1, and there is always at least one d e e cd(G) such that d e = 1, e.g. if q = i±. Therefore, 

( y 

D\(G) r = Yl d e contains all terms cF g of D r (G) besides other cross-product terms > 1. 

\d e e cd{G) J 

Therefore: 

(3.8) D r (G) < Di(G) r , r > 1. 

Similarly the sum product D r (G)D s (G) = £ d' e Yl d s q contains all terms d r g and 

d e e cd(G) d<, e cd(G) 

d* of D r (G) and D S (G) respectively, besides other cross-product terms > 1, and therefore 

(3.9) D r+S (G) < D r (G)D s (G), r, s > 1. 
From (3.9) we can write the following. 

(3.10) D r (G) < D 2 {G)D r _ 2 {G) = \G\ D r _ 2 (G), r > 2. 

For a fixed group G, D r (G) is a convex function of the inverse £ of the index r > 1, meaning 
that: 

(3.11) D s (G) l l s < D r (G) l l r , 1 < r < s. 

There is a useful monotonicity result for sums of powers of irreducible character degrees of 
subgroups. 
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Lemma 3.8 For any subgroup H < G, D r (H) < D r {G), and D r (H) < D r (G) iff H <G, 
for all real r > 1. 

Proof. For any g e Irrep(G) and -d e Irrep(H), by Frobenius reciprocity (Theorem 3.6), 
l ind%#, 8 = l Res% B ,fr and > further, by Proposition 3.5, d# < d Q if l Ind c^ g = l Res a g ^ > 0. Fixing 
age Irrep(G), we have: 

d $ = E d#< Y l Res% e ,D d $ = d Res% e = d B- 

■& e Irrep(H), « /nd G,, ie >0 d e Irrep(H), l Rea G g ^>0 d e Irrep(H) 

Taking r th powers in the above estimate, for r > 1, by the reasoning in (3.11), we obtain: 
E d $ - E d& - E l Res% e ,s d v = d l- 

OeIrrep(H),l Res G e ^>0 \t e Irrep(H), l Res G e ^>0 J \0 e Irrep(H) ) 

If, in the above estimate, we sum over all g e Irrep(G) and omit the intermediate sums, we 
obtain: 

E E 4< E d l = Dr(G). 

q e Irrep(G) i? e Irrep(H), l Res G p ,}>0 B e Irrep(G) 

Since S — S S dj, we obtain the estimate: 

e Irrep(H) q e Irrep(G) 1? e Irrep(H), l Res G g ^>0 

D r (^)= E d s< E E 4< E ^ = ^r(G). 

1? e Irrep(H) q e Irrep(G) ■& e Irrep(H), l Reg G g $>0 Q e Irrep(G) 

This proves the first part of our claim. For the second part, we note that H = G implies that 
D r (H) = D r (G). If H < G, i.e. is a proper subgroup of G, then H C G and \H\ < \G\, and 
D\ (H) < D\ (G) (proof left to the reader), and using the first part, it can easily be seen that 
D r (H) < D r (G) for all r > 1. ■ 

3.1.6 Estimates for Maximal Irreducible Character Degrees 

Here, we derive lower and upper estimates for the maximal irreducible character degree d 
of a finite group G with character degree set cd(G). First, we note that (3.10) may be 
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sharpened further using d' . By definition, d < d' for all d e cd(G), so that for r > 2, 
D r (G) = £ d r e = £ d^ 2 d 2 g < d' r ~ 2 ■ £ d 2 8 = d' r ~ 2 D 2 (G) = d' r - 2 \G\. We 

d g e cd(G) d B e cd(G) d e e cd(G) 

record this for later use: 



(3.12) D r (G) < d' r - 2 D 2 (G) = d' r - 2 \G\, r > 2. 

For convenience, we denote c(G) by c. For each d e e cd{G) we know that d Q \ \G\ and 
1 < d 2 < \G\, and therefore, that there is an integer < e g = \G\ — d 2 such that d 2 + e g = \G\, 
i.e. that d e = (|G| — e^) 1 ^ 2 . We denote by l\ the trivial irreducible representation of G of 
dimension d L1 = 1, so that e L1 = \G\ — d 2 Ll = \G\ — 1. If e g = \G\ — d 2 = for any d Q 
e cd{G) then |G| = d 2 and G has only the one irreducible representation g = ii, which is 
true iff G is trivial. Thus G is nontrivial iff all the e e > 1. If we let e = \G\ — d' 2 then 

1 /2 

1 < d' = (\G\ - e') < (\G\ - 1) 1/2 . The case d' = 1 means that d e = 1 for all d e e 
cd(G), which is true iff G is Abelian. We have d' > 2 whenever G is non-Abelian. The case 
e = 1 <^=^ d' = (\G\ — l) 1 / 2 > 1, is exceptional: this forces |G| = d 2 to be the sum 

dg e cd(G) 

\G\ = d 2 + d 2 Li = d' 2 + 1, where d' = Dim g for some g e Irrep(G) of maximal dimension. 

/ / ' 

However, since d \ it must be that d \ 1, which means that d = 1, \G\ = 2, G must be a 

cyclic group of order 2. Thus, d' = (\G\ — l) 1 ^ 2 > 1 can occur only for d' = 1 with G cyclic of 

order 2. Thus, the case 2<d < (\G\ - 1) 1/2 holds iff G is a non-Abelian group, which shows 

that e = 2<d < (\G\ - 1) 1/2 implies that \G\ > 6. The case 1 = d' < (\G\ - 1) 1/2 is true iff 

G is an Abelian group of order > 2. 

Now we turn to the lower estimate for d\ for which 1 is always a trivial value. A tighter 
lower bound may easily be obtained as follows. By definition, d s < d' for all d Q e cd(G). 
Then, since \G\ = D 2 (G) = £ d] < £ d' 2 = d' 2 ■ £ 1 = cd' 2 , we have that 

d e e cd(G) d e e cd(G) d e e cd(G) 

d > {^jr\ ^ ■, where 1 < c < \G\. We consider necessary and sufficient conditions for G such 



that d reaches the lower bound ( ^\ exactly. The case d' = is equivalent to the 



case |G| = £ d 2 = cd 2 , and since 1 < c < this can only occur iff all d g = d = 1, 



J2 _ „/2 

dg e cd(G) 

1/2 



which is true iff G is Abelian. Thus, when G is Abelian, = 1 = d' < (\G\ - 1) 1/2 , with 
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an additional equality on the right iff G is cyclic of order 2. This shows that y^) = 1 = 

1 /2 

d < (|G| - 1) 1/2 iff G is Abelian of order > 2. The case d = {^f} > 2, with G Abelian, 
is impossible, since G always has the trivial irreducible character x Ll of degree d Ll = 1, so that 

1 /9 

\G\ = < + £ d 2 Q ± cd' 2 . Thus, (M) < d' iff G is non-Abelian, which is true iff 

d > 2, in which case 1< c < |G| and 1< (^P)^ also. Thus, 1 < (^P)^ < d' < (|G| - 1) 1/2 
holds iff G is non-Abelian, and implies that |G| > 6. Thus, we have proved the following result. 

Theorem 3.9 For a nontrivial finite group G with a maximal irreducible character degree d' (G) 
and class number c(G) it holds that 



(1) 1< 


\c(G)) 


1/2 <d'(G) < (|G| -1) 1/2 


general case 


(2) 1 = 


( \G\ ) 


1/2 = d'(G)<(|G|-l) 1/2 


iff G is Abelian 


(3) 1 = 




1/2 = d'(G) = (|G|-l) 1 / 2 


iff G is cyclic of order G = 2 


(4) 1 = 


( \G\ ) 


1/2 = d'(G)<(|G|-l) 1 / 2 


iff G is Abelian of order G > 2 


(5) 1< 


\c(G) 


1/2 <d'(G)<(|G|-l) 1/2 


iff G is non-Abelian ( / =^ G > 6) 



(Note: (2) - (4) are trivial.) 

From the upper bound for d' (G) and the estimate (3.12), we obtain the estimate: 
(3.13) D r (G) < \G\ (|G| - 1)^, for all r > 2. 



3.2 Regular Group Algebras 
3.2.1 Canonical Decomposition 

Our main reference here is [BCS1997]. The g e Irrep(G) linearly extend to injective (C-algebra) 
homomorphisms F e : CG — ► t^d e xd e Q £ dmieiisions Dim F Q = d e defined by: 
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(3.14) f= £ f(9)9 F e (f) = £ /(sMs) = /(^), / * CG, e e /rrep(G). 



By the irreducibility of the £ e Irrep(G) the define distinct irreducible matrix represen- 
tations of CG, and form a complete set Irrep(CG) of such representations. The direct sum 
homomorphism F = © F e : CG — ► C deXde of dimension |G| = £ ^ 

e e Irrep(G) g e Irrep(G) g e Irrep(G) 

defined by: 

(3.15; / = £ /(<7)<7 — f = F(f) = © £ /G?M<7) = © /(e), / e CG, 

jeG Irrep(G) g e G e Irrep(G) 

is injective and surjective, and, therefore, the isomorphism: 

(3.16) F= © F e :CG^ c © C d * xd e. 

q e Irrep(G) g e Irrep(G) 

This results in Wedderburn's theorem about the canonical decomposition of CG as an 
isomorphic direct sum of c(G) complex matrix algebras of orders the c(G) distinct irreducible 
character degrees d e of G. Taking dimensions on both sides of (3.16) this gives us another 
version of (3.4)- The matrix algebra on the right of (3.16), whose elements are block-diagonal 
matrices, is called the target algebra of CG. Iff G is Abelian all its irreducible character degrees 
will be of size 1, the matrices of the target algebra of its regular algebra CG will be diagonal 
of order |G|, and multiplication in CG will be pointwise and equal in complexity to that of 
diagonal matrix multiplication of order |G|. 

3.2.2 Multiplicative Complexity and Rank 

The (bilinear) multiplication maps of isomorphic C-algebras are isomorphic, in the sense of 
Corollary 2.3, which is also true for algebras, and by (3.16), we have: 

(3.17) m CG ^ c © {d e ,d e ,d e ), 

g e Irrep(G) 
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where these are the multiplication maps of CG and its target algebra, respectively. The rank 
of CG is defined to be rank 9t(m CG ) of its bilinear multiplication map m CG : CG x CG — ► CG, 
which is defined to be the length of the minimal bilinear computation needed to express the 
product of any two elements of CG (see section 2.1.2 in Chapter 2), and, therefore, cannot be 
less than Dim CG = |G|. But, |G| is also simultaneously the rank 9K\g\ and the dimension of 
the vector space C' G ' which forms an algebra under pointwise vector multiplication. Thus, we 
have the relation: 

(3.18) 9t|G| = |G| < 9t(m CG ) = %\.( © (d g ,d e ,d e )) < £ 9t({d e ,d e ,d e )) . 

\8 £ Irrep(G) J g e I„ep{G) 

Equality above holds as \G\ = fH(m CG ) = £ 9*«1, 1, 1» = £ &({d e ,d e ,d e )) 

g e Irrep(G) Q t Irrep(G) 

iff G is Abelian. 

3.3 Generalized Group Discrete Fourier Transforms 
3.3.1 Generalized Group Discrete Fourier Transforms 

Any C-algebra isomorphism F of the form (3.16) is called a generalized discrete Fourier trans- 
form (DFT) on CG, equivalently, a generalized group discrete Fourier transform on G, and 
defines a |G| -dimensional matrix representation of CG on its target algebra also of dimension 
|G|, where CG is called the time domain of F and the target algebra © (£d e xd e j g ca rj e( } 

g e Irrep(G) 

its frequency space or Fourier domain [BCS1997, p. 327]. F is of dimension Dim F = |G|, 
and has an invertible \G\ x |G| block-diagonal matrix of full rank \G\ denoted by [F], called a 
DFT matrix for CG, w.r.t. any fixed bases of CG - e.g. its regular basis G - and of its target 
algebra. Every choice of such distinct basis pairs yields a distinct DFT and a DFT matrix 
for CG. Any DFT F on CG has a unique direct sum decomposition © F e , where the 

q e Irrep(G) 

F s are the irreducible components of F in (3.16), with each F e faithfully mapping CG onto 
C d B xd e. Given a DFT F on CG, for an / e CG, F(f) = f is called the Fourier transform of /, 
for a fixed g e Irrep(G), f(g) defined by the formula (3.14) is called the Fourier transform of / 
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at g, and the elements of < f(g) \ are called the Fourier coefficients of / which define 

I ) QeIrrep{G) 

f. There is an inversion formula for recovering / from its transform [SER1977]. 



(3.1 9) f(g) = IGP 1 £ d Q -Tr f(g)g{g- 1 ) , g e G. 

QtIrrep(G) 

This formula defines the inverse DFT of an / e CG. If G is Abelian all the d e = 1, so 
that the 1-dimensional g e Irrep(G) may be replaced, in (3.14) and (3.21), by their irreducible 
characters \qi an °f degree 1. This yields the familiar Fourier transform and inverse transform 
formulas for finite Abelian groups [SER1977]. 



(3.20) f( Xe ) = £ f(g)x e (9), Q e Irre P (G), 

g e G 



(3.21) f{g) = IGf 1 £ f(x e )X e (9), 9 e G. 

QtIrrep(G) 

A DFT F on CG has an invertible matrix [F] of order |G|, whose columns correspond to 
the group elements g e G, and whose rows correspond to the distinct irreducible representations 
g e Irrep(G). For any g e G and any g e Irrep(G), g{g) is an invertible matrix of order d e 
indexed by 1 < k g , l e < d e , whose d 2 g number of entries g{g)k e ,i e occur in [F] by the following 
formula [SER1977]. 

(3.22) [F] e ^ le . g = g{g) ke , le . 

Every choice of basis pairs in CG and its target algebra yields a distinct DFT F and a 
DFT matrix [F] for CG, and the class {[F]} of all DFT matrices [F] for CG is determined 
uniquely by the g e Irrep(G). 
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3.3.2 Discrete Fourier Transform on Sym 3 



Here we present the example of [BCS1997, pp. 329-330]. Consider Syms, the symmetric 
group of all permutations of 3 symbols. The 6 permutation elements of Sym 3 are the identity 
permutation (1), the three transpositions (12), (13), and (23), and the two cycles (123) and 
(132), and these three subsets of elements form the three distinct conjugacy classes C e , Ct, and 
C c , respectively, of D 3 , where e denotes the no-change permutation, t denotes a transposition, 
and c a 3-cycle. Sym 3 has the trivial 1-dimensional irreducible representation 1 corresponding 
to e, which is defined by g 1 — ► (1), the nontrivial 1-dimensional irreducible representation a 
corresponding to t, which is defined by g 1 — ► sgn(g), and the 2-dimensional irreducible repre- 
sentation A which is defined explicitly by the mappings: (1) h 



1 




1 




, (12) — 




1 




1 





-1 




1 -1 




-1 




-1 1 


(13) — 


-1 1 


, (23) — 


-1 


, (123) — 


1 -1 


, (132) ^ 


-1 



The 

distinct irreducible character degrees of Sym 3 are d L = 1, d a = 1, and c?a = 2, such that 
df + dl + d 2 A = 6. By (3.16) the regular group algebra CSym 3 of Sym 3 then has the canonical 
decomposition CSym 3 ^ c C d ' xd ' C d ° xd ° © C d * xd * = C lxl © C lxl © C 2x2 . The DFT ma- 
trix [F] for CSyms, w.r.t. canonical bases in the components of its target algebra, by formula 
(3.24), will be the 6 x 6 matrix: 





(1) 


(12) 


(13) 


(23) 


(123) 


(132) 


^1,1 


1 


1 


1 


1 


1 


1 




1 


1 


1 


-1 


-1 


-1 




1 





-1 





1 


-1 


Ai )2 





-1 


1 


1 


-1 





A 2 ,i 


1 


1 


-1 


1 





-1 


A 2 ,2 


1 


-1 








-1 


1 



We see that formula (3.24) prescribes that the entries of the column corresponding to a g 
e Sym 3 are the coefficients of the linear forms obtained from the entries of the matrices t(g), 
a(g), and A (g). 
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3.3.3 Complexity and Fast Fourier Transform (FFT) Algorithms 

For a given finite group G with regular group algebra CG, we can think about a discrete Fourier 
transform F on G as a linear transformation defined by DFT (/) = / for any given / e CG, 
where / is a matrix valued function on Irrep(G), e.g. / (g) e C d e xd Q for any g e Irrep(G). We 
see that a DFT on G is described by the product of a \G\ x |G| matrix by a vector of length 
|G|. If we write Mp (G) as the total number of arithmetical operations {x, +, — } required to 
implement a given group DFT F on G, then we see that 



(3.23) \G\ < M F {G) < 2\G\ 2 . 



An efficient group DFT algorithm, also called a fast Fourier transform (FFT), is one which 
minimizes Mp (G) for any given Fourier transform F, i.e. by reducing the upper limit 2 \G\ 2 . 
The famous Cooley-Tukey algorithm is an FFT to compute the DFT on the cyclic group Z/nZ 
in Mp (Z/nZ) = O (nlogn) operations [MR2003, p. 283]. It is out of the scope of this thesis 
to discuss the FFTs on groups further, but we will conclude by noting that according to Maslen 
and Rockmore, who present an up-to-date survey of the field, Mp (G) < O (\G\ log holds 
for all Abelian groups G, and for arbitrary groups G they conjecture that there are constants C\ 
and C 2 such that Mp (G) <Ci\G\ log° 2 \G\, [MR2003, p. 286]. This was perhaps suggested by 
the discovery for symmetric groups Sym n that Mp (Sym n ) = O (n!log 2 ra!) [MR2003, p. 286]. 
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Chapter 4 



Groups and Matrix Multiplication I 



Here we introduce the basic group-theoretic approach of embedding matrices into group algebras 
via triples of subsets of the groups having the so-called triple product property, and studying the 
complexity of matrix multiplication in terms of certain numerical parameters relating to the size 
of groups, the degrees of their irreducible characters, and the sizes of the matrix multiplications 
realized by them. The methods discussed here pertain to the group algebra embedding of 
a single arbitrary pair of matrices, and the recovery of their product via multiplication in 
the group algebra, while in the sequel to this chapter, Chapter 5, we describe methods for 
the simultaneous embedding into a group algebra of several pairs of matrices, and recovering 
their independent products simultaneously via a single multiplication in the algebra. In the 
concluding part 1^.3 of the chapter, we describe a number of ways of proving estimates for to 
using the methods outlined earlier. 

4.1 Realizing Matrix Multiplication via Groups 
4.1.1 Groups and Index Triples 

Henceforth, G shall always denote a nontrivial, finite group. For any nonempty subset 5CG 
its right-quotient set, denoted by Q(S), is defined as: 
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By the definition above, 1q e Q(S) necessarily for all right-quotient sets of subsets S of G. 
The relation 



(4.2) \Q(S)\ > \S\ 

is a simple consequence of (4-1) since a fixed s e S the elements s's -1 , for arbitrary s e S, 
are distinct elements of S. Equality in (4-2) always holds for any subgroup S < G. 

A triple (S, T, U) of nonempty subsets S,T,U C G is said to have the triple product property 
(TPP) if the following condition holds. 

(4.3) s s~ l t t~ l u u~ l = 1 G s's" 1 = i't" 1 = uu~ l = 1 G , s's" 1 e Q(5), t't -1 e Q(T), 
uu" 1 e Q(U). 

A subset triple (S, T, U) of G which has the triple product property is called an index triple 
of G, for which we can derive an elementary property. 

Corollary 4.1 If (S,T,U) is an index triple of G then the mapping (x,y) i — ► on any 

distinct pair X, Y e {S, T, U} is injective. 

Proof. Since S, T, U C G, by assumption, satisfy the triple product property, for arbitrary 
s, s e S, t, t e T, u, u e U, it is the case that s ' s~H 't _1 u ' u~ x = 1q <^=^ s = s, t = t, u = u. 
Then for arbitrary elements s, s e S and t, t e T, u, u e U, we see that 

s~H = 8~H' 

==> s s~ 1 tt ~ 1 uu ~ 1 = 1 
=>■ s = s, t = t. 

We can prove, in the same way, the injectivity of this mapping for all other distinct pairs in 
{S, T, U}. m 
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For any triple of subgroups S, T, U < G the triple product property condition may be 
expressed as: stu = 1q iff s = t = u = Iq, s e S, t e T, u e U, since Q(S) = S, Q(T) = T, 
Q(U) = U iff S,T,U <G. 



The following is a trivial result. 

Lemma 4.2 If G is any group then (1) G, {1g},{1g} is o, triple of subroups having the triple 
product property, and (2) G x {1^} x {1^} , {1g} x G x , {^g} x {^g} x G is a triple of 
subgroups having the triple product property in G x3 . 

For Abelian groups there is an equivalent characterization of the triple product property by 
maps, as expressed in the following lemma. 

Lemma 4.3 If G is Abelian, then (S,T,U) is an index triple of G iff' the triple product map 
■ip : S x T x U — ► G, defined by (s,t,u) i — ► stu, is injective. 

Proof. Let G be Abelian. If subsets S, T, U C G satisfy the triple product property, then 
for any two elements (s,t,u), (s ,t' ,u) e S x T xU: 



The converse is also true. If tp is injective on S x T x U then for any two elements (s,t,u), 
(s',t',u) e S xTxU: 



i/j(s',t',u) 



III . . 

s t u = stu = ip{s, t, u) 



I _1 ' _1 ' 

s s t t u u 



-1 




s s t t u u 



-1 



1g 



/ / / 

s t u = stu 




la, u u 



1 



1g- 
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The following is an elementary corollary: 

Corollary 4.4 If G is Abelian and (S,T,U) is an index triple of G, then \S\ \T\ \U\ < \G\. 
Equivalently, if (S,T,U) is an index triple of G such that \S\ \T\ \ U\ > \G\ then G is non- 
Abelian. 

Proof. By Lemma 4-3, the triple product map ip on an index triple (S, T, U) of an Abelian 
group G is necessarily injective and, therefore, S x T x U = \mip C G. Taking cardinalities 
on either side, we have that \S x T x U\ = \S\ \T\ \U\ < \G\. The equivalent statement follows 
from the negation of the previous statement. ■ 

The property of G having an index triple is invariant under permutations of the components 
of the triple. 

Lemma 4.5 A subset triple (S, T, U) is an index triple ofG iff any permuted triple (// (S) , \i (T) , fj, (U)) 
is an index triple of G, for a permutation /j, e Sym{S, T,U}. 

Proof. Assume (S,T, U) has the triple product property. Then, for all s s~ l e Q(S), t't^ 1 
e Q(T), uu- 1 e Q(U) 

ttSSUU = 1(3 

' — 1 ' — 1 ' — 1 
==> S S t t U U =i-G 

=>■ S S = t t = U U = 1(5. 

This shows that (T, S, U) has the triple product property if (S, T, U) does, and in the same 
way, we can show that (S, U, T) has the triple product property, and so do all other permuted 
triples (T,U,S), (U,S,T), (U,T,S), because (T,S,U) and (S,U,T) generate the permutation 
group Sy m{S, T,U}. ■ 
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4.1.2 Extension Results for Index Triples 

We start with a basic statement about index triples of subgroups. 

Proposition 4.6 If (S, T, U) is an index triple of a subgroup H < G then (S, T, U) is an index 
triple of G. 

This follows from the definition (4-3) of an index triple of G. Index triples of groups can 
also be obtained as extensions of index triples. of normal subgroups and of their corresponding 
factor groups. 

Lemma 4.7 // (Si, S2, S3) is an index triple of H < G and (U±, U2, Us) is an index triple of 
G/H, then there exists a subset triple (T\,T2,T%) of G, corresponding to {U\, U2, Us), such that 
the pointwise product triple (S±Ti, S2T2, S3T3) is an index triple of G, where the Ti C G are 
lifts to G of the Ui. 

Proof. Elements of G/H are left-cosets gH of H in G, the subsets U\, U2, Us C G/H are 
of form 

U = {ui = ViH I Vi e G} , 1 < i < 3. 

We define lift subsets Tj C G of the Ui by 

Ti = {U e G\ U = Vihi, some hi e H, and U{ = ViH e Ui, some Vi e G}, 1 < i < 3. 

The Ti, which are not necessarily unique for the U, have the properties that (1) UH = Ui, 
for all U e T L and m e Ui, (2) U { ^ T { , and (3) t e T { implies T { n tH = {t} , 1 < i < 3. Let 
sijSi e Si,*!,^ e TijUi,^ e C/i, and S2,s 2 e S2,t2,t 2 e T 2 ,U2,u 2 e and S3, S3 e £3^35 4 
e T3, 7x3,^X3 e C/3 be arbitrary elements. Then s' 1 t' 1 tj~ 1 s^ 1 s 2 i2^2 lfi 2 lfi 3*3*3 1,s 3 1 = implies 
s' 1 t' 1 ^ 1 s^ 1 s 2 ^2^2 1,s 2 ls 3^3^3 1,s 3 X ^ = H ■> which implies i x H (t\H)~ x t 2 H fcH) -1 t' 3 H (tsH)^ 1 = 
H, which implies u 1 u^ 1 u 2 U2 1 u 3 u 3 1 = Ig/Hj which implies u i = U{ (assumption of TPP for 
the Ui in G/H) which implies t { H = t{H, which implies t[ = ti, which implies, by the first 
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inequality, s' 1 s 1 l s' 2 s 2 1 s' 3 s 3 1 = 1h, which implies s[ = Si (assumption of TPP for the Si in 
H<G). m 

In general, the pointwise product of two index triples of G is not necessarily an index triple 
of G. 

We define the set 3(G) to be the collection of all index triples of G. Formally: 
(44) 3(G) := {(S,T, U) \ S, T, U CG satisfy the triple product property (4.3)} . 
By Proposition 4-5 we have: 

(4.5) 3(H) C 3(G), H < G, 
and: 

(4.6) \3(H)\<\3(G)\, H < G. 

Now we have an important extension result for the index triples of direct product groups. 

Lemma 4.8 If groups G\ and G2 have index triples (Si,T±,Ui) and (S2,T2,U2) respectively 
then the direct product of these triples, (Si x S2, T\ x T 2 , U\ x U2), is an index triple ofG\ XG2. 

Proof. For any subsets S\,Ti,U\ C G\ and S2,T 2 ,U2 C G2, we define for G\ x G2 
the subsets Si x S 2 = {(si,s 2 ) \ si e 5i, s 2 e 52}, T x x T 2 = {(ti,t 2 ) I *i e Ti, t 2 e ^2}, 
U 1 xU 2 = {(«i,it2) I «i e C/i, n 2 e ?7 2 } C Gi x G 2 . We call (Si x 5 2 ,Ti x T 2 , E7i x f/ 2 ) the 
direct product (S u T u U ± )x (S 2 ,T 2 , U 2 ) of the triples (S ± , T u U ± ) and (S 2 ,T 2 , U 2 ). It is sufficient 
simply to assume the triple product property for the triples (S±,T±, U±) and (S 2 ,T 2 ,U 2 ), and 
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then, for arbitrary Si,^ e Si, e Ti, ui,u'i e £/i, S2,s 2 e 5*2, £2,^2 6 ^2, U2,u 2 e ^2, we see 



that: 

s l s l Vl u \ u \ = IGd " s 2 s 2 *2*2 u 2 n 2 = 

s'^S- 1 = i'^- 1 = u'^ 1 = l Gl , s' 2 S 2 1 = 4*2 1 = u 2«2 1 = ^2 

si = si, h = h, Ui = ui, s 2 = s 2 , i 2 = *2, u 2 = u 2 
(• s 'i> s 2) (si,s 2 ) _1 = ^i,4) (*i,*2) _1 = (u'^u'^j (u 1 ,u 2 )~ 1 
= (1Gi,1g 2 ) 

= ^S-^S-^ ^1^2. ^1^1 7 ^2*^2 ^2^2 ^2^2 ^ 

= ( s 'l>4) (S1,S 2 ) _1 (t'l,4) (*1,*2) _1 (Vl,« 2 ) («1,«2) _1 - 

■ 

If we denote by 3(Gi x G 2 ) the set of index triples of G\ x G2, by Lemma 4.8 we have the 
following. 



ft.7> 3(G 1 xG 2 )D3(G 1 )x3(G 2 ). 



ft.*; |J(Gi xG 2 )| > \1{G 1 )\\3{G 2 )\. 
4.1.3 Groups and Matrix Tensors 

From Chapter 2, we recall the definition of the stuctural tensor, or simply, the matrix tensor 
(n,m,p) K as the i^-bilinear map (n,m,p) K : K nxm x K mxp — ► j( n xp^ wri ich describes the 
multiplication of n x m matrices by m x p matrices over K, with resulting product matrices 
in the matrix vector space K nxp . We omit the subscript K and say that G realizes a tensor 
(n,m,p) via an index triple (S,T,U), iff \S\ = n, \T\ = m, \U\ = p, where these are positive 
integers, and, by definition, (S,T,U) has the triple product property. In this case, the index 
triple (S,T,U) said to correspond to the tensor (n,m,p). Loosely speaking, as will become 
clear later, this means that G "supports" the multiplication ofnxmbymxj) matrices indexed 
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by subsets S, T, U C G, in the sense of fact (I), section 1.3, Chapter 1. By assumption G is 
nontrivial, so that by Lemma 4-2, G always realizes the tensors (1, 1, 1) and (2 < |G| , 1, 1), and 
G x3 always realizes the tensor (\G\ , \G\ , \G\). The following describes an elementary property 
for tensors of subgroups. 

Proposition 4.9 // (n,m,p) is a tensor realized by a subgroup H < G, then (n,m,p) is also 
realized by G. 

For G we define the set 6(G) as: 

(4-9) 6(G) := {(n,m,p) \ G realizes the tensor (n,m,p)}. 

&(G) is the set of all tensors (n,m,p) realized by G. By (4-5)-(4-6) we have the following 
results. 

(4.10) &{H) C &(G), H <G, 
and: 

(4.11) \e(H)\<\6(G)\, H < G. 
&(G) is necessarily finite by the finiteness of 2(G). 

For arbitrary tensors (n,m,p) and permutations fi e Sym^ we denote by fi({n,m,p)) the 
permuted tensor (fx (n) , /j, (m) , fj, (p)). Then we have an elementary result. 

Lemma 4.10 A group G realizes a tensor (n, m,p) iff' it realizes any permuted tensor fx ((n, m,p)) = 
(n (n) , \x (m) ,(i(p)), where fx e Sym^. 

Proof. A consequence of Lemma 4-5. ( The reader will note the similarity between this 
lemma and Proposition 2.1. It will be shown that this is, in fact, a group-theoretic version of 
Proposition 2.1.) ■ 
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This means that if G supports multiplication ofnxmbymxp matrices over K it simultane- 
ously supports multiplication of matrices, over K , of all possible permutations of the dimensions 
n x m and m x p, i.e. it also supports multiplication of n x p by p x m matrices, of m x n by 
nxp of matrices, of m x p by p x n matrices, of p x n by n x m matrices, ofpxmbymxp ma- 
trices. As an example, we note that by Lemma 4-1, any group G realizes the tensors {\G\ , 1, 1), 
(1, |G| , 1), (1, 1, \G\). We denote M((n, m,p)) to be the set {p((n, m,p)) \ fi e Sym^} of all 
permutations of a given tensor (n,m,p). If we write a tensor (n,m,p) in a "normal" form, 
where n ^ m ^ p, then (n,m,p) can be taken to be the representative of the set M((n,m,p}). 
Thus, (n,m,p) e &(G) implies that M((n,m,p)) C 6(G), and therefore 6(G) can be rewritten 
as: 

(4-12) 6(G) := U M((n,m,p}). 

G realizes (n,m,p), n<m<p 

For arbitrary tensors (ni,mi,pi} and {ri2,m2,P2) we define a pointwise multiplication op- 
eration • defined by (ni,mi,pi) • {ri2,m2,P2) '■= {nini,mim2,piP2), which is associative, com- 
mutative, and has the unit (1, 1, 1). 6(G) need not be closed under pointwise products. This 
operation allows us to characterize certain important extension results about tensors. 

4.1.4 Extension Results for Matrix Tensors 

Lemma 4.11 If a normal subgroup H <d G and the corresponding factor group G/H realize 
the tensors {n\, 7x2,713) and (mi, 7/12,7/13), respectively, then G realizes the tensor (711,712,713) • 
(7111,7112,7713) = (7117111,7127112,7137113), where (711,712,713) and (7111,7112,7113) correspond to certain 
representative index triples of H and G/H resp., and (711,712,713) • (7111,7112,7113) corresponds to 
the pointwise product of these index triples. 

Proof. A consequence of Lemma ^.7. ■ 

An analogous result applies to direct product groups. 
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Lemma 4.12 If groups G\ and G2 realize tensors (ni,mi,pi) and (712,7712,^2), respectively, 
then their direct product G1XG2 realizes the pointwise product tensor (ni, mi,pi) ■ {ri2, 777 2 ,p 2 ) = 
(n\n2, rnim2,piP2) , where (ni,mi,pi) and (712,7712,^2) correspond to certain representative in- 
dex triples ofGi andG2 resp. and {n±, m\,p\) and (ri2, rri2,P2) corresponds to the direct product 
of these index triples. 

Proof. A consequence of Lemma 4-8. ■ 

Thus: 

(4-13) 6(Gi x G 2 ) 5 6(d) • 6(G 2 ). 

4.1.5 Group-Algebra Embedding and Complexity of Matrix Multiplication 

The following is a fundamental result describing the embedding of matrix multiplication into 
group algebras via the triple product property. 

Theorem 4.13 If(n, m,p) e 6(G) then (1) (n, m,p) <k vcvkg and (2) 5ft ((n, m,p)) < K (mjfc). 

Proof. Assume that G realizes {n,m,p) through an index triple (S,T,U), i.e. subsets 

S,T,U C G have the triple product property, and |5| = n, |T| = m, = p. First we prove 

that there exists a restriction of vcikg to (n, m,p), where vcikg is the (if -bilinear) multiplication 

map of the group K-algebra KG of G. Let A = (Ay) e K nxm and B = (B fk ) e K mx P be 

arbitrary n x m and m x p if -matrices respectively. The product of A and B is the n x p 

if -matrix AB = C = (G^) with entries Co- determined by the formula Gik = Yl AjBjk-, 

3=3' 

1 < i < n, I < k < p. We index the entries of A by S and T, and of B by T and U as follows: 



Aij — A s j, 



s = s(i),t = t(j); 1 < i < n, 1 < j < m; 
* =MJ),m = u(k); 1 < j < m, 1 < k < p. 
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We define linear maps a : K nxm — ► KG and b : K mxp — ► KG for embedding the matrices 
A = (A St t) and B = ^B t ' into the group i^T-algebra KG of G as follows: 

a(A) = A= Y A s,ta~H; 

s e S,t eT 

b(B) = B = Y B t',J~^- 

t' eT,ueU 

The injectivity of the mappings (s,t) i — ► s~ 1 t and (t,u) i — ► t~ 1 u on S x T and T x U 
respectively, proved in Lemma 4-1, means that Ker a = {O nxm } and Ker b = {O m xp}, where 
O nX m and O mX p are zero matrices of dimensions n x m and m x p respectively, which proves 
the injectivity of a and b. We index the n x p matrix product AB = C = (Cik) by S and U as 
follows: 

Cik = Cs,m s = s(i),u = u(k); 1 < i < n, I < k < p 

We define an injective linear embedding map c :K nxp — ► KG as follows: 

c(C) = C= Y C s,us- l u. 

S € S, U € U 

The product of A and B in KG is given by: 

AB = Yl A s,ts~H- Y B t',J~ lu 

s e S,teT t' tT,ueU 

= E E ^tB t ^ u s-ht- l u 

s e S, t e T t ' e T , u e U 

= E E A s,tB t i tU tt- l \ s - l u. 

s e S,ueU \t t t' e T j 

Clearly, for each distinct pair s e S, u e U, C StU = A s,tBt, u - By assumption, (S,T,U) 

t=t' e T 

is an index triple of G, which means that for arbitrary elements s e S, u e U, s ~ l u = 
s^ 1 tt'^ 1 u -4=>- s' s~ 1 tt'~ 1 uu'~ 1 = 1g is true iff s = s, t = t, u = u. But the sum of those 
terms of AB for which t = t all have the group term s'~ l u and the coefficient As' t^t u 

t=t' eT 
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corresponds 1-to-l with the (i,k) th entry Cik of C in K nxp as given above. Thus, 

c(C) = C = AB = a(A)b(B). 
Then, we define an extraction map j: : K nxp < — KG by: 

l(AB) = C = (dk) 

where the Cj k * are coefficients of the terms s u in AB, for 1 < i = i (s ) < n, 1 < k = 
k'(t) < p, s'eS, t'eT. Clearly t = o -1 -b -1 , and by y we will recover the desired matrix product 
C = AB from AB. By the injectivity of the maps a and b it follows that p = a -1 -b -1 = c -1 . 
Since, for each (A, B) e K nxm x K mxp , we have the composition p o vcikg ° (a x b) (A, B) = C 
e K nxp , it follows that: 

? ° vcvkg ° (a x b) = {n,m,p) . 
i.e. {n,m,p) <k tuxGj which proves (1). (2) follows from applying Proposition 2.2 to (1). ■ 
If K = C then we have an elementary corollary. 



Corollary 4.14 If (n,m,p) e 6(G) then (1) (n,m,p) < c m C G =C © (d e ,d e ,d g ), (2) 

q e Irrep(G) 

(nmp) 3 < 5R((n,m,p)) < 3f?(mcG) < I] $t((d Q ,d g ,d g }), and (3) (nmp)^ < $l((n,m,p)) < 

g e Irrep(G) 

\G\ if G is Abelian. 

Proof. For (1) we apply (3.17) to part (1) of Theorem 4.13. For (2) we apply (3.18), 
Proposition 2.6, and Proposition 2.13 to part (2) of Theorem 4-13. For (3) we note that if G 
is Abelian then K(mcG) = \G\. From the latter case, we can also deduce that to < — 

log(nmp) ' 

if G is Abelian and (n,m,p) e ©(G). ■ 
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4.2 The Complexity of Matrix Multiplication Realized by Groups 



4.2.1 Pseudoexponents 

For tensors (n,m,p) we define their size or order by z ((n,m,p)) = nmp, and we write for 
their t th powers (nmp)*, where t > is any real number. If t = | then (nmp) 1 / 3 is just the 
geometric mean of the components of {n,m,p), i.e. the mean size or mean order of {n,m,p). 
We define by &' (G) the set of all tensors of size > 1 realized by a nontrivial group G, i.e. 
S (G) = 6(G) \ {(1,1,1)}, and for any tensor (n,m,p)e& (G), nmp > 2. Since G is nontrivial, 
by Lemma 4-1, G always realizes the tensor (2 < |G| , 1, 1) and ©'(G) > 1. 

We define for G a number called its pseudoexponent a(G) by: 



(4.14) a(G) := min flog, , 1/3 IGl) = log 

l ^ * y v 7 ( W ) e e'(G) V & (™ m P) 1 7 



max (nmp) 1 ^ 3 l^l - 
(n,m,p> e 6'(G) 



By the definition and finiteness of &'(G), a(G) necessarily exists. From above, we see that 
a(G) is uniquely determined by a maximal tensor (n ,m ,p ^ / (1,1,1) realized by G, i.e. 
a tensor (n' ,m ,p'^ e ©'(G) such that nmp > nmp for all other tensors (n,m,p) e &'(G). 
Formally: 



(4-15) z (G) := z [In ,m ,p')) ■= max 



(n,m,p) e & (G) 



nmp. 



It follows that: 



(4-16) 1 < nmp < n m p 



(n, m,p) e ©(G). 



The components of (n,m,p ) are the sizes 



= n 



= m 



If 



= p of a maximal 



index triple (^S' ,T' , ll'^j of G, which need not be unique. a(G) can be redefined as: 



(4.17) a(G) :=\og z , {G)1/3 \G\. 
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This is equivalent to: 



(4.18) z\G) = \G\^). 

We note that z (G) can be understood as the maximal size of matrix multiplication sup- 
ported by G, and z' (G)s is the geometric mean of this maximal size. 

It follows from Proposition 4-9 that: 

(4.19) z'(H) < z'(G), H < G. 

The following is an immediate consequence of Lemma J^.ll. 
(4-20) z'(G 1 )z'(G 2 ) < z'(G), G = Gi x G 2 . 

It follows from (4-1 4) that: 

(4.21) a(G) < log (nrop)V 3 |G|, (n,m,p) e 6(G). 
For any positive integer n it follows that: 

(4.22) a(G) <logJG|, (n,n,n) e 6(G). 

The lower and upper bounds for a(G) are determined by the following fundamental lemma. 
Lemma 4.15 For any group G, 2 < a(G) < 3. If G is Abelian then a(G) = 3. 
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Proof. By Lemma 4-2 G realizes the tensor (1, 1, |G|) of size |G|, which shows that a(G) < 3 
by (4-21). For the lower bound, we note first that, for any index triple (S,T,U) e 3(G) with 
associated tensor (n,m,p) e &(G), by Lemma 4-1, the mappings (s,t) i — ► s _1 t, (s,u) i — ► s _1 u, 
(t, u) i — ► t" x u on SxT, Sxll, and T x U respectively, are injective, which means that nm < \G\, 
np < \G\, and rap < \G\. We now prove that if equalities hold in these inequalities then p = 1, or 
m = 1, or n = 1, respectively, starting with nm < |G|. Assume that nm = \G\ S _1 T = G. 
Then, for arbitrary elements u, u e U and s e S and t e T, there exist unique s e S and 
t e T such that s" 1 ^ = s' -1 itu' -1 i, which implies s s^t't^u u -1 = s s'~ 1 uu~ 1 tt~ 1 uu~ 1 = 
uti'^^'n -1 = Iq- Hence, u'u^ 1 = Iq, and u = u, i.e. \U\ = p = 1. In the same way we 
can prove that np = \G\ ==> m = 1, and mp = |G| => n = 1. Hence, if {n,m,p} e &(G) 
then not all of n, m, p = 1, so that no£ all of nm, np, mp = |G|, i.e. if G realizes an index 
triple (S,T,U) corresponding to a tensor (n,m,p) then (nmp) 2 < |G| 3 and, therefore, nmp < 
|G|*. Therefore, *'(G) < |C?|' maximally, and a(G) = log z ' (G) i /3 \G\ > log^ G|3/ ^i /3 |G| = 2. 

Finally, if G is Abelian and has the maximal matrix tensor (n ,m ,p'^J of size z '(G) = nmp 
then, by the Corollary 4-4 to Lemma 4-3, z '(G) < \G\. This implies that log| G |i/ 3 |G| = 3 < 
log z '(ay/3 \G\ = a(G), i.e. a(G) = 3. The negation of the preceding statement is that a(G) < 3 
implies that G is non-Abelian. ■ 

This leads to an elementary corollary. 

i i 

Corollary 4.16 If (n,m,p) e &(G), (nmp) * < |G| 2 . 

By Lemma 4-15: 
(4-23) |G| < z'(G) < |G| 3/2 . 

The following is another elementary result. 

Corollary 4.17 a(G) < 3 iff z (G) > \G\. Equivalently, a(G) < 3 iff nmp > \G\, for some 
tensor (n,m,p) e 6(G). 
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Thus, the closer z (G) is to |G|, the closer a(G) is to 3 and G is close to being the 3 rd power 
of the maximal mean order of matrix multiplication that it supports. The closer z (G) is to 
|G| 3 / 2 , the closer a(G) is close to 2 and G is close to being the 2 nd power of maximal mean 
order of matrix multiplication it supports. For example, if G\ and G2 are two finite groups 
such that a(G\) < 0(^2), then G\ is at least as "efficient" in supporting matrix multiplication 
as Gi-, or more efficient if a(G\) < a(C?2). 

For subgroups we have an easy result. 



Lemma 4.18 For any nontrivial subgroup H < G, a(G) < log z > (h) 1 /'* [G : ff] + a(H). 
Proof. \G\ = [G:H] |ff|, and from (4.19) z '(H) < z (G). Therefore, 

log|G| 



a(G) = 



log z'iG) 1 / 3 

log[G:H] log \H\ 



log z'iG) 1 / 3 logz'(G)V3 
< log[G:H] | log |ff I 



logz^ff) 1 ^ logz'(ff)i/3 
log [G : H] 



log z'(H) 1 / 3 



+ a (ff ) . 



For normal subgroups we have the following basic result. 



Lemma 4.19 For any nontrivial normal subgroup H < G and corresponding factor group 
G/H, a(G) < max(a(ff),a(G/ff)). 

Proof. Let (m l ,m 2l rn^ e 6(H) and (p'i,P2,P3^ £ &(G/H) be the maximal tensors 
realized by ff < G and its factor group G/H, respectively, and let (n^n^n^ e &(G) be the 
maximal tensor realized by G. Then, by (4-18), we have the identities: 

z '( H ) a W = \h\ 3 , z'(G/ff) a(G/ ^ = |G/ff| 3 , z'(G) a{ - G) = |G| 3 . 
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By Lemma J^Al (Tn 1 p 1 ^m 2 I>2^^P^) = \ m i? m 2? m 3/ " \P11P21P3) 6 an d therefore: 



z {H)z (G/H) 



= m[p[m 2 p 2 m' 3 p 3 
i t i 



iin 2 n 3 

z'(G) 



by the maximality of (n^n^n^ for G. Then also 

(z'{H)z'{G/H)y {G) = z'{H) a ^z'{G/H) a ^ < z (G) a ^ . 
Using the identities \H\ \G/H\ = \G\, and \H\ 3 \G/H\ 3 = \G\ 3 , we see that: 

z\G) a ^ = z'(H) a W z '( G / H )°WH) m 

If mex(a(H),a(G/H)) = a{H) and a(G) > a(H) then: 

(z{H)z (G/H)y (G) = z'(H) a ^z'(G/H) a ^ 

> z'(H) aiH h'{G/H) a W 

> z'(H) a W z '( G/H )°{G/H) 

= z'(G) a W 

i.e. a contradiction. Similarly, if m&x.(a(H), a(G/H)) = a(G/H) and a(G) > a(G/H) then: 

{z'{H)z'(G/H)y {G) = z'(H) a ^z'(G/H) a ^ 

> z'(H)^ G / H h'(G/H)^ G / H ^ 

> z'(H) a W z '( G / H )°(G/H) 

= z'(G) a W 
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also a contradiction. Thus it must be that a(G) < a(H), a(G/H), which means that: 

a(G) < msx(a(H),a(G/H)). 

Equality above holds trivially if G is Abelian. ■ 

For direct product groups we have the following result. 

Lemma 4.20 a (G xk ) < a (G), where G xk is the k-fold direct product of G. 
Proof. By (4.20) z (G xk ) > z ' (G) k . Then 



«(c xfc ) = log/ (Gxfc) i/3 



G xk 

k 



y 

= ^ lo g/(G)V3|G| 

= a(G). 



This means that for k = 1,2,3,.... we have a descending sequence of pseudoexponent in- 
equalities, ... < a ((jr x3 ) < a (G x2 ) < a(G). We do not know of general conditions on 
the G xk for making this sequence strict, though it would require a strict ascending sequence, 
z (G) < z (G x2 ) < z (G x3 ) < . . ., for the corresponding maximal tensors z (G xk ) of the G xk . 

For explicit estimates of the exponents of specific types of groups we refer the reader to 
sections 5-7 in [CU2003], since for the derivation of estimates of the exponent oj we have found 
the simultaneous triple product property more useful. However, we do give some estimates for 
the exponents of the symmetric groups in sections 6.1.2-6.1.3 in Chapter 6. 

4.2.2 The Parameters 7 

Let d' (G) be the largest degree of an irreducible character of a group G. We define for G the 
number 7(G) by: 
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(4.24) 7(G) :=inf{ 7 eK+ | \G\$ = d' (G)} . 



By Theorem 3.10 d' (G) < (|G| - 1) 1/2 < |G| 1/2 , hence it follows from the definition (4.24) 
that 7(G) > 2. Since for a fixed group G, lim jGj 1 ^ 7 = 1, and d' (G) = 1 for an Abelian 

7 >oo 

group G, we, therefore, define 7(G) = 00 if G is an Abelian group. We note that 7(G) can 
always be computed as: 

(4.25) 7 (G) = log,, (G) \G\ 

provided we know d'(G). An example: d' (Sym^) = 2, and therefore ^(Sym^) = log 2 6 « 
2.585. 

By Theorem 3.10 we know that (^jy) 1 ^ < J (G) < (|G| - 1) 1/2 iff G is non-Abelian, and, 
therefore, the bounds for the 7(G) of non-Abelian groups G, are given by: 

(4.26) 2 T ^<,(G)<2 lo J^Uoy 

For example, c(Sym 3 ) = 3, and therefore 2 ^°^^ = 2j*§ « 2.226 < 7 (Sym 3 ) 
log 2 6 « 2.585 < 5.17 « = 2 «^ 



log(|5j/m 3 |-l) log5 

ggl 

log6-log3 z 'log|5j/m3|-logc(5i/m.3) ' 



This is a basic result for normal subgroups. 

Lemma 4.21 For any nontrivial normal subgroup H <\ G such that (1(G) > max (ct (H), d' (G/H)j , 
7(G)< 7 (^) + 7(G/F). 

Proof. For a nontrivial normal subgroup H <\ G the assumption of d' (G) > max (c( (H) , d' (G/H^j 
means that 

7 (G) - l0g|G| 



log d'(G) 



log |ff I + log|G/tf| 



log d'(G) logd'(G) 
log |ff I log|G/ff| 



\ogd'(H) \ogd'(G/H) 
= 1 {H)+ 1 {G/H). 
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This is a basic result for direct product groups. 

Lemma 4.22 ^(G xk ) = 7(G), where G xk is the k-fold direct product of G. 
Proof. We observe first that d' (G xfc ) = d' {G) k , [SER1977]. Then 

7 (G xfc ) = lo g(/(GXfc) G 

k 



xk 



log d > {G)k \G\ 
y 

y l °g d '(G)\ G \ 
7(G). 



4.3 Fundamental Relations between a, 7 and the Exponent u 

Here we derive important relations between the exponent to and the parameters a and 7. 
4.3.1 Preliminaries 

Let u be the usual exponent of matrix multiplication over C. The following is an important 
result. 

Theorem 4.23 |G|^ = D 2 (G)^& < D^G). 



Proof. Let (n ,m ,p'j e 6(G) be the maximal tensor realized by G of size z '(G) = 
n m p uniquely determining a(G), and by definition (4-18) z (G) = n m p = |G| . Ushi£ 



61 



Proposition 2.13 and Corollary 4-14'- 

(n'm'p'Y = \G\^=D 2 (G)^ (*) 

< 3? (J^n ,m ,p^ 

< Yl X((d e ,d e ,d e )). 

q t Irrep(G) 

From Theorem 4-13 (n,m,p) <k © {d e ,d e ,d e ) and taking r th tensor product powers 

g e Irrep(G) 

on either side we obtain 

(n r ,m r ,p r ) < K © (d 8l ■ ■ ■ d 8r ,d ei ■ ■ ■ d Qr ,d Ql ■ ■ ■ d Qr ) . 

Q\ Q T e Irrep(G) 

By Proposition 2.12 for each e > there exists a constant C £ > 1 such that for all k we have: 

K({k,k,k)) < C £ k^ e . 
Hence, taking ranks on either side of (*) we obtain that: 

\g e Irrep(G) 

= C e D u+e {G) r 

for some C £ > depending on some e > 0. Taking the r th root on either side we obtain 

D 2 {G)^a) < ^ +e (G). 
If we take the limit as r — ► oo, and then the limit as e — ► we obtain finally that: 

D 2 (G)^m < D U (G). 



By the maximality of (n ,m ,p ) in 6(G) we have an elementary corollary. 
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Corollary 4.24 If (n,m,p) e &(G) then (1) (nmp)^ < D w (G) h , and (2) (nmp)^ < d\G) l ~ » |G|» . 

Proof. For any (n,m,p) e 6(G), by (^.i^) and Theorem 4-23, (nmp) 1 > < z (G)% < 
L> 2 (G)«( G > < and taking roots, we have the result. Part (2) is a consequence of 

applying (3.12) to the right-hand side of (1). ■ 

Theorem 4-23 can be reexpressed as the relation. 
(4-27) |G|^ < D u {G)h. 

Using (4-18) we know: 
(4.28) \G\*fa < D W (G)^ < |G|i 

In the impossible case that a(G) = 2 we would have that |G| 5 < D U! (G)^ < \G\* , which 

would imply that oj = 2. However, since by Lemma 4-15 a(G) > 2 always it follows that 
i i 

|G| a < G ) < |G| 2 always and, therefore, the first estimate in (4-28) will be strict if oj could be 
pushed to 2. 

The following is a useful result. 

Corollary 4.25 D r (G) < |G|^ +1 for r > 2. 

Proof. By (3.12) D r {G) < d' {Gf- 2 \G\ for r > 2, and by (4.25) d' (G) = |G|^> . Then 

D r (G) < (\G\W^y 2 \G\ 
= |G|^) . 

■ 

Using the above, we can prove the following fundamental relation. 
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Corollary 4.26 IfG is a non-Abelian group such thata{G) < 7(G) thenuj < a (G) 



7(G)-2 s 

7 (G)-a(G) 



Proof. By Theorem 4.23 \G\^°) < D U (G). For r = u in Corollary 4.25 D U {G) < 
\G\%® +1 , from which we derive \G\^& < \G\^ +1 . This implies that < ^ + 1, which 
is equivalent to uj (^^jy — ^^j) < 1 — ^jy- Since 7(G) — a(G) > by assumption, it follows 
that (y^Q^ — ;^by) > 0- Dividing both sides of the previous estimate by (^^jy — ;^Gj) we S e t 



4.3.2 Fundamental Results for the Exponent uj using Single non-Abelian 
Groups 

1 1 

Corollary 4.27 If G is a non-Abelian group such that \G\ Q ( G > > D^(G)a then uj < 3. Equiv- 
alently, uj < 3 if z (G)% > D 3 (G)% . 

Proof. If |G|^W > r> 3 (G)3, by $.2$;, £> 3 (G)s < |G|^> < D W (G)», which implies 
that by the convexity property (3.11), uj < 3. The second part follows from the fact that 
\G\^h = /(G) I (see (4. 18)). m 

This is a trivial result because it has been proven that uj < 2.38 [CW1990]. More useful is 
the following. 



Corollary 4.28 (1) uj < t < 3 for some t > 2, if there is a non-Abelian group G such that 
a(G) < 7(G) and a(G) ( ^(Q-a(G) ) — (^) ^ n e 3™va/eni, ^ more precise statement is that 
uj < t < 3, /or some i > 2, if there is a non-Abelian group G such that z (G)s > d (G) and 



> G. 



d'(G) 

Proof. By Corollary 4.26 uj < a{G) (^p^y) if a(G) < 7(G). This means that if, in 
addition, a(G) (^pyr^y) < * for some 2 < t < 3 then uj < t. (2) From (4. 17), (4.23), and 
(4-25), we see that a(G) < 7(G) is equivalent to z (G)\ > d' (G). By (1) the additional condi- 
tion a(G) ( 7 gg; ( 2 G) ) < t needed to prove w < t is equivalent, to ^ffigj^ " 2 ) < 
( ; log ]?L — ; — lo fjfl /, ) t. Dividing both sides of the inequality by loglGI we will still have 

\ log a (G) log 2 (G) 1 < M / 1 1 

a term on the left with numerator log|G|, and making it the subject of the inequality on 
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the left, this becomes log |G| < tlogz'(G)* + (2 — t) log d' (G) = log 2' (G) s - logd'(G)(*- 2 ) = 
/ t 

log /(Q^(t-2) ■ Taking antilogarithms we have the result. ■ 

For any given group G, from (4-23) we see that |G|s < z (G)s < |G| 2 , and from part (5) 
of Theorem 3.10 c(G)~3 < d' (G) < (|G| - 1)3 if G is non-Abelian. The intersection 
of these intervals lies in the open interval ^c(G)~2 |G| 5 , |G| 5 ^, and Corollary 4-29 will let 
us prove to < t < 3 for some t > 2 if we can find a non-Abelian group G realizing matrix 
multiplication of largest size z (G) and with an irreducible character of largest degree d' (G) 
such that c(G)-5 |G|2 < d\G) < z (G)* < \G\* < * (G) L • 

d (G) ^ 

4.3.3 Fundamental Results for the Exponent u using Families of non- 
Abelian Groups 

The following results describe ways of proving that lo = 2 via families of non-Abelian groups. 
The first is as follows. 



Corollary 4.29 If {Gk} is a family of non-Abelian groups such that a (Gk) = at = 2 + o(l), 
and 7 (Gfc) = 7 fc = 2 + o(l), and — 2 = o(7 fc — 2), as k — ► 00, then uj = 2. 

Proof. Assuming the conditions a k = 2 + o(l), 7 fc = 2 + o(l), a k — 2 = 0(7^ — 2), as 
/c — ► 00, for the family {G k }, we will have 

(«* - Ik) 
= (a fc - 2) - ( 7fc - 2) 

= ( 7fc -2)-( 7fc -2) 

< -\(l k -2)<0 
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for sufficiently large k. Then by Corollary 4-26, as k 



oo, we will have 



oo < a k ( 7fc 2 ) 

Ofc 

(l-(a fc -2)/( 7fc -2)) 

2 + o(l) 
l-o(l)/o(l) 
2 + o(l) 
l-o(l) 
— 2+. 



From ^.iSj, z'(G)§ = |G|^, and from (4.25), d' (G) = \G\^ , and for a family {G k } 
of non-Abelian groups G k realizing matrix multiplications of maximal sizes z k = z (G k ) and 
maximal irreducible character degrees d' k = d' (Gk), the conditions a k = 2 + o(l) and 7 fc = 
2 + o(l) are equivalent to the conditions log|Q ^ = 1 + o(l) and log(|Gfcl 7 lp = 1 + o(l), 

log ^ lo S^ 

1 'I 1 , 

respectively, which are implied by the conditions \G k \ 2 — z k = o(l) and (|Gfc| — I) 2 —d k = o(l), 

respectively. Here, we describe a specific result for a family of non-Abelian groups satisfying 

the latter conditions. 



Theorem 4.30 Let {Gk} be a family of non-Abelian groups Gk realizing matrix multiplications 
of maximal sizes z' k = z (G k ) and with maximal irreducible character degrees d' k = d' k (G). 
Then, (1) u = 2 if \G k fi - z k A = o(l) and (\G k \ - 1)5 - <4 = o(l) such that \G k \* - zj* = 
((\Gk\ — I) 2 ~~ ^k) as k — y °°- And more generally, (2) u = 2 z/ |G&| — ► oo as k — > oo 
and there exists a sequence {C k } of constants C k for the G k such that 2 < C k < \G k \ — 1, 
\G k \ >C k (l + ch), C k — oo, Ck = o(\G k \), (\G k \ - Ck) 1 * -d' k = o(l), \G k \* - z} = o(l) 
and \G k \ 2 — z k = o ( (\G k \ — C k ) 2 — d k J , as k — ► oo. 

Proof. For an arbitrary group G, if we compare (4-16) and (4-25), we see that a(G) < 7(G) 

iff z'(G)s > d' k (G), a(G) = 7(G) iff z'(G)3 = d'(G), and 7(G) < a(G) iff z'(G)5 < d'(G). 

/ 1 1 / 

Moreover, a(G) is close to 2 iff z (G) 3 is close to |G| 2 , and 7(G) is close to 2 iff d (G) is close 



66 



to |G|i 

(1) By Theorem 3.10, (^§y) 2 < d' (G) < (\G\ - 1)2 < |G|* for a non-Abelian group G, 

, i _ 

therefore, for the non-Abelian family {Ck} the most that we can have is d k — ► {\Gk\ — l) 2 , 
, i_ 

as k — ► oo. But d k — ► (\Gk\ — l) 2 , as k — ► oo implies j k — ► log,, G , ^1/2 \Gk\ = 
21og(|(j fc !_!) |Gfc| — ► 2 + , i.e. 7 fc = 2 + o(l), and if, in addition, z k — >-\Gk\ 2 faster 

than d' k — > (\Gk\ — 1) 2_ as k — > oo then ak = 2 + o(l) and 7 fc = 2 + o(l) such that 

i 'I i , 

at — 2 = 0(7^ — 2). This can also be written as \Gk\ 2 — z k = o(l), (|Gfc| — l) 2 — d k = o(l) 

3 ; — / 1 / \ 

and \Gk\ 2 — z k = o I (\Gk\ — 1) 2 — d fc ) , as k — ► oo, which implies a& = 2 + o(l), j k = 2 + o(l) 
and ak — 2 = 0(7^ — 2), as — ► 00, which, by Corollary J±.29, implies that lo = 2. 

(2) Assume all the conditions in (2). In particular, for the constants 2 < Ck < — 
1, the condition |Gfc| > Cfc ( 1 + c 1 _ 1 ) means that 7 fc = logy \Gk\ < logy (|G^| — C^) + 
logy Ck- Then, the condition (\Gk\ — Ck) 2 — d k = o(l), implying d k — > {\Gk\ — Ck) 2 ~ , as 

k 

k — > 00, together with \Gk\ — ► 00, Ck — ► 00, Ck = o(\Gk\), as k — > 00, implies that 

Ik — ► 2 (log ( | Gfc |_c fe ) (|Gfc| - C k ) + log(|G fc |-Cfc) Ck) = 2 + o(l), as k — ► 00. In addition, the 

I '- 1 '- / 1 , \ 

conditions \Gk\ 2 — z k 3 = o(l) and \Gk\ 2 — z fe 3 = o ( (\Gk\ — Ck) 2 — d k j , — ► 00, imply that 

afc — > 2 + faster than j k — ► 2 + as k — ► 00, i.e. ak = 2 + o(l) and 7 fc = 2 + o(l) such that 

ak — 2 = o(7 fc — 2), as A; — ► 00, which, by Corollary 4-29 implies that to = 2. m 
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Chapter 5 



Groups and Matrix Multiplication II 



Here we extend the methods introduced in Chapter 4 to study the complexity of simultaneous 
independent multiplications of several pairs of matrices via a single group using the concept of 
simultaneous triple products. We derive some important results that bound the exponent u 
in terms of the sizes of simultaneously realized tensors of single groups in relation to the sizes 
of the groups. In our analysis, it appears that the sharpness of estimates for u is positively 
related to the number of simultaneous matrix multiplications supported by a group, and also 
that the best groups, in this regard, seem to be groups which are wreath products of Abelian 
groups with symmetric groups. 



5.1 Realizing Simultaneous, Independent Matrix Multiplica- 
tions in Groups 

5.1.1 Groups and Families of Simultaneous Index Triples and Tensors 

We define the right-quotient set Q(X,Y) of any pair of subsets X, Y of a finite group G by: 



(5.1) Q(X,Y) = {xy- 1 | xeX, y e Y} . 
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Let I be a finite index set. A collection {(Si,Ti,Ui)} i e j of triples (Sj,Tj,C/j) of subsets 
Si,Ti,Ui C G, of sizes \Si\ = mj, |Tj| = p^, = % respectively, is said to satisfy the 
simultaneous triple product property (STPP) iff it is the case that: 



said to simultaneously realize the corresponding collection {(mi,pi,qi)} i e 1 of tensors through 
the collection {(S^Tj, J7i)}j e T , which is called a collection of simultaneous index triples. For 
such collections, the triple product property (4-3) becomes a special case of the simultaneous 
triple product property when |/| = 1. Thus, every triple in a collection {(Si, T{, Ui)} i e l of 
simultaneous index triples of G is an index triple of G, though there is no converse for collections 
of index triples. The i th tensor (rrii,pi, qi) in {(rrii,pi, e j is the matrix multiplication map 
C"' xmi x C miXpi — ► C n,XJ,! , and the significance of the simultaneous triple product property 
is that it describes the property of G realizing the collection of tensors {(mi,pi, qi)} i e j via a 
collection {(Si,Ti,Ui)} i e r of index triples in such a way that |/| simultaneous, independent 
matrix multiplications can be reduced to one multiplication in its regular group algebra CG, 
with a complexity not exceeding the rank of the algebra. 

5.1.2 Group-Algebra Embedding and Complexity of Simultaneous, Inde- 
pendent Matrix Multiplications 

Theorem 5.1 // {(m,i,pi, qi)} i e j C ©(G) is a collection of tensors simultaneously realized by 
a group G then 



(5.2) each (Si,Ti,Ui) satisfies the TPP and s' i Sj 1 t'jt k . 1 u' k u i 1 = 1q => i = j = k 



for all s'^j 1 e Q(Si,Sj), t-t^ e Q(Tj,T k ), u k u i 1 e Q{U k ,Ui), i,j,k e I. In this case, G is 




q e Irrep(G) 




and iff in addition G is Abelian then 
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Proof. The procedure used here is a natural generalization of Theorem 4-13. If S V ,T V ,U V C 
G, 1 < v < r, is a collection of r triples satisfying the simultaneous triple product property, 
and {(A v , B v )} r v=1 is a given collection of r pairs of m v x p v and p,, x q v matrices A v = (Ai v j v ) 
and B v = ( B ./ , ) respectively, then we embed these pairs in CG as 

&v (A v ) — A v = A Svj f v s v 1 t v 

b v (B v ) = B v = ^2 B^ u t~ x u v 

t' v e T v , u v e U v 

via pairs of injective, linear embedding maps a v : C mvXpv — ► CG and b v : C PvXqv — ► CG, 
using the triples S V ,T V ,U V , one triple for each pair, just as described in Theorem 4.13. For 
each v, the (i v , k v ) th entry C ivkv of the product C v = A V B V is given by C ivjv = J2 A ivjv B j v k v - 

. ./ 

Jv—3 V 

The product of A v and B v in CG is given by 

A V B V = A s v ,t v s-H v - Yl B t' v ,uJ^ lu v 

s v t S v , t v e T v t' v e T v , u v e U v 

s v e S v , t v e T v t' v e T v , u v e U v 

s v eS v ,u v eU v \t v ,t' v eT v J 

As in the proof of Theorem 4-13 for a given v, we can recover the matrix product C v = A V B V 
from A V B V by a linear, injective extraction map jc v : C mvXqv < — CG defined on the fact that 
for arbitrary s' v e S v , u' v e U v , the sum of those terms of A V B V for which t' v = t v all have 
the group term s'~ l u, n and the sum of coefficients of these terms, Y] A> , B, / , cor- 

tv = t v € Tv 

responds 1-to-l with the (i v ,k v ) th entry Ci v k v of C v = A V B V . If tv denotes the embedding 
map C mvXqv — ► CG, this shows that p v (A v B v ) = C v = c" 1 (C v ). For each v, we have the 
composition o mcG ° (<*i> x b v ) (A V ,B V ) = C v e C mvXqv , by which we have the restrictions 
h ° nvcG ° (flt> x M = (m v ,p v ,q v ) of m C G to (m v ,p v ,q v ), i.e. (m v ,p v ,q v ) < c m C G, by which we 
deduce 9\((m v , 

Pv,Qv)) <c ^H(ntcG) (Proposition 2.2). 
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Now we prove that these restrictions are simultaneous and independent. We define the 
direct sum matrices A = A v e c mt,xp ", and B = B v e (&C PvXqv . The product AB 

v=l v=l v=l v=l 

r r 

e © £m v xq v j g direct sum © A V B V of the r block products A V B V of blocks ^ and B v of 
dimensions m v x p„ and p v x g„ respectively. We embed A and S in CG by linear embedding 
maps a and b defined by 

r r 

a (A) = A = J2 E A Sv , tv s-H v = Y^ V 

v=ls v e S v , t v e T v v=l 
r r 

r r 

Clearly, a = Yl a v an d b = ^ b„, and are injective by the injectivity of the a v and b v . The 

v=l v=l 

product of A and B in CG is given by: 



AB = ^2A v Y,B v 

v=l v=l 

r r 

= EE E E ^v^b^j-hj- 1 ^ 

v=lw=U v e S v ,t v eT v t ' w eTwiUw e Uyj 
r r I \ 

= EE E E ^uB^jj- 1 s^ Uw . 

v=lw=l \s v e S v , t v eT v t ' w e Tw> Uw t U w / 

If we use a third index 1 < I < r, then by the simultaneous triple product property, for 
arbitrary s' t e Si, u\ e Ui, it is the case that sf 1 u l = s~ l t v t w l u w s^s^ 1 = t v t!~ l = u w uf l = 
1 I = v = w. This means that for each v, and s v e S v and u v e U v , the coefficient of the 
term s" 1 ^ in the product AB is Yl A Sv>tv B tvjUv = {A V B V ) S In this way, we can recover 
the r block products A\B\, A2B2, A r B r simultaneously from AB, and each block A V B V will 
be the v th diagonal block on the block diagonal product AB. If we define an extraction map 
y : C mxq < — CG based on this rule, then y = © jc v where C mxq = C mvXQv , and we have 

v=l v=l 

shown the following restriction y o mcG* (a x b) (A,B) = AB e C mxg of mcc to ( m ,P,q), 
i.e. (m,p,q) <c rncG; by which we deduce 9\((m,p,q)) < 9^(iticg) (Proposition 2.2). By 
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r r 



Proposition 2.5, (m,p,q) = ( ^m v , ^p v , ^q v ) = © (m viPviQv): and by Proposition 2.2 

\v=l v=l v=i I v=1 

This takes care of (1). For (2) we note that note that 9t(mcG) = I C| iff G is Abelian. ■ 
An immediate consequence is the following. 

Corollary 5.2 If {{mi,pi,qi)} i e l C 6(G) is a collection of tensors simultaneously realized by 
a group G then 

("HPift)^ < DUG) 

i e I 

and if G is Abelian 

(2) < \G\- 

i e I 

Proof. Assume that {{mi,Pi, qi)}; e j ^ ©(G) is a collection of tensors simultaneously 
realized by G. (1) By part (1) of Theorem 5.1, (3.18) and Proposition 2.14 

it/ ft Irrep(G) 

(1) On the right-hand side, by Proposition 3.13 D U1 {G)= £ ci£ < £ 9t ((d e , 

p e Irrep(G) q e Irrep(G) 

Since {mi,pi,qi) e ©(G), by Corollary 4.16, it follows that (rriipiqi) 3 < |G| 2 = Z?2 (G) 2 < 
£> W (G)*. Thus, 

^(m^)t < |J|£) W (G)* 

j e 7 

<^=^ 

2_ 

ie I Kiel J 

(2) D r {G) = |G| for all r > 1 iff G is Abelian, and the result follows by (1). ■ 

Part (2) of Corollary 5.2 points to the usefulness of Abelian groups for estimates of uo, for 
which we have the following useful corollary. 
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Corollary 5.3 If {(n,n,n)} r i=1 is a collection of r identical square tensors (n,n,n) simultane- 
ously realized by an Abelian group G then 

n\ s 1 °S\G\ - logr 
logn 

and 

(2) oj = 2 if \G\ = n 3 and r = n. 
Proof. Consequence of part (2) of Corollary 5.2. ■ 

5.1.3 Extension Results 

The following is a basic extension of the simultaneous triple product property to direct product 
groups. 

Lemma 5.4 If groups G and G' have collections of simultaneous index triples {(Si, Ti, Ui)} i e T , 
\ (S./jT-,, £/"•/) \ t of sizes r and r resp., then their direct product G x G has the collection 

I ) i' e I 

of rr simultaneous index triples I (Si x S if ,Ti x T^, U{ x UAy 

I J i e I, i'e I' 



Proof. For arbitrary indices k e I and i ,j' ,k' e I , and elements [sijS-, ) e Si x S'-,, 



e Sj x S' jh (tj,t'j?J e Tj x T'-,, (t k ,t k ,^ e T k x T k ,, (u k ,u k ?j e U k x U' k ,, (uj,^') e 
Ui x \j' v , and the assumption of the simultaneous triple product property for both the collections 
{(Si, Ti, U i )} i e j and ((^,,7^,, f^,) } , it is the case that: 

(**>4) (Sj>^') (*fc,*fc') («*!,«*/) 

, s i>Sf ) [tjt k ,t f t k , J (u^ ,u k ,u v J 
= (^iSjhjt^UkU^ 1 , s'ys'j, 1 t r t k , u'^u'./^ = (1 G ,1 G >) 

SiS^tjt^Uklir 1 = l G , t'jdv u'^u'./ = 1 G > 

=> s i sj 1 t j t k 1 u k u~t 1 = l G , s^s^tytv u k ,uj = \ G i and 
i = j, j = k, k = i, i = j', / = k', k' = i . 
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This has an equivalent statement in terms of tensors. 



Corollary 5.5 If groups G and G have collections of simultaneously realized tensors {(mi,pi, <?i)}j e / 
and ^(rn'^jPi', ^'^j ., ^ of sizes r and r resp., then their direct product G x G' has the collec- 
tion of rr simultaneously realized pointwise product tensors I (mim^jPiP-^qiq,,) > . 

I \ / J i e I, i'e I 

Lemma 5.4 and Corollary 5.5 are also independent consequences of Lemma 4-8 and Lemma 
4-12 using the simultaneous triple product property (5.2). 



5.2 Some Useful Groups 

Here we describe some special types of finite groups of particular interest to our problem. 

5.2.1 The Triangle Set A n and the Symmetric Group Sym n ( n+1 y 2 
For an arbitrary fixed n > 1, we define the triangle set A n by: 

(5.3) A n := {x = (xi,x 2 ,x 3 ) e N 3 | x\ + x 2 + x 3 = n - l}. 



A n is of size |A n | = ^/c = l + 2 + -- -- + n = n(n + l)/2. The following is a table for A 5 
k=l 

[n = 5) written lexicographically: 





Xl 


X2 


X3 


XI+X2+X3 




Xl 


X2 


£3 


X1+X2+X3 




X 1 


X2 


£3 


X1+X2+X3 


1. 


4 








4 


6. 


2 





2 


4 


11. 





4 





4 


2. 


3 


1 





4 


7. 


1 


3 





4 


12. 





3 


1 


4 


3. 


3 





1 


4 


8. 


1 


2 


1 


4 


13. 





2 


2 


4 


4. 


2 


2 





4 


9. 


1 


1 


2 


4 


14. 





1 


3 


4 


5. 


2 


1 


1 


4 


10. 


1 





3 


4 


15. 








4 


4 
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The smallest triple in A n is (0, 0, n — 1) and the largest (n — 1, 0, 0). The i th component X{ 
of any triple (xi, x 2 , X3) e A n can take any one of n values 0, 1, 2, .n — 1, and for any value 
< k < n — 1 and component index 1 < i < 3, there are exactly n — k triples (xi,X2,X3) e 
A n with the i th component Xi = k. This is a representation of A5 as a triangular array or 
pyramid of dot elements: 



1. (4,0,0) 



2. (3,1,0) 3. (3,0,1) 



• • • 

4. (2,2,0) 5. (2,1,1) 6. (2,0,2) 



7. (1,3,0) 8. (1,2,1) 9. (1,1,2) 10. (1,0,3) 



• • • • • 

11. (0,4,0) 12. (0,3,1) 13. (0,2,2) 14. (0,1,3) 15. (0,0,4) 



Counting the rows of this pyramid from the lowest, for < k < n — 1 = 4, the k th row of 
dots correspond to the subset of triples in A5 with I s * component x\ = k, and in the k th row 
each element is ordered component- wise descending order from left to right. This is precisely 
the lexicographic (dictionary) ordering of the elements of A n . 5'yw- n ( n +i)/2 can be understood 
as the permutation group of A n , and we may write <S , ym ri („ +1 )/ 2 = Sym(A n ). Sym(A n ) is of 
order Qn(n + 1))!. Elements fi e Sym(A n ) are bijective maps A n = A n and their actions on 
the components of triples x = (xi,X2,X3) e A n is defined by Xi 1 — ► fi(x)i, 1 < i < 3, where 
/j,(x)i denotes the i th component of the permuted triple fi(x). Graphically, the permutations 
fi e Sym{A n ) are bijective transformations, such as rotations or reflections, of A n or of any 
subset of points of A n . 



We define the subsets Syrrii(A n ) C Sym{A n ) by: 
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(5.4) Syrrii(A n ) := {fi e Sym(A n ) \ fi(x)i = x h x e A n }, 



1 < i < 3. 



Each Symi(A n ) forms a fixed-point subgroup of Sym(A n ) consisting of those permutations 
of A n leaving the i th components of triples x e A n fixed. For any value < k < n — 1 and 
index 1 < i < 3, there are exactly n — k triples in A n with i th component x« = k, there are 
(n — k)\ permutations of these triples, and for each 1 < i < 3, there are n!(n — 1)! • • • -2!1! 
permutations of A ra which fix the components of triples x e A n , and \Syrrii(A n )\ = nl(n— 1)!- 
• • -2!l!. Graphically, the subgroups Sym,i{A n ) < Sym (A n ) are collections of permutations ^ e 
5ym (A n ) transforming A n solely along the diagonal rows parallel to its i th side, one subgroup 
for each side. The following is a diagram for Symi(A^), Sym^As), Syms(A^) on A5. 



The diagram above makes it clear that these fixed point subgroups have the triple product 
property. 

Lemma 5.6 The subgroups Symi(A n ), Syrri2(A n ), Syms(A n ) < Sym(A n ), defined in (5.2), 
form an index triple of Sym(A n ). 
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Proof. Since Sym,i(A n ) < Sym(A n ), 1 < i < 3, to prove the triple product property for 
these, it suffices to prove for arbitrary /i 1 e Symi(A n ), /j, 2 e £?/m 2 (A n ), and fi 3 e Sym^(A n ) 
that ^^2^3 = 1 implies that fii = /x 2 = fi 3 = 1. For a n e Sym(A n ), we define its fixed 
point set as fix (fi) = {x e A n \ n(x) = x} C A n , and its i th component fixed point set fixi (fi) 
as fixi (fi) = {x e A n \ fi(x)i = Xi} C A n . For arbitrary fj, e Sym(A n ), the sets fix(fi) and 
fixi (fi) are such that fj, = 1 iff /ix (//) H /ixj (fi) = A n , for all 1 < i < 3, where 1 is the identity 
permutation of A n . Moreover, fix (pi) C fixi(fi). Then, from /U 1 ^ 2 M3 = 1 it follows that 
fix (H1H2V3) n f ix i (M1M2M3) = f ix (^1/^3) = A n , 1 < i < 3. Since /zxi (//J = fix 2 (/U 2 ) = 
(^3) = A n, it follows that fix (/xj = /ix (/x 2 ) = /ix (/x 3 ) = A n . Together, /ix (^^2^3) = 
A n and /ix (X) = A n , 1 < z < 3, implies that fixi (n x n 2 ) = fi%i = f ix i OiAO = A n, 

1 < i < 3, which implies that fix(/j, 1 /j, 2 ) = /ix (/x 2 /x 3 ) = fix(fi 1 fi 3 ) = A n , 1 < i < 3, which 
implies that ^iP 2 = /"2M3 = ^1^3 = 1> horn which we deduce that fi ± = fi 2 = ^3 = 1- ■ 

/ n n n \ 

This shows that Sym(A n ) realizes the tensor ( FJ k\, ]J k\, f\ )) which means that it 

U=l k=l k=l I 

n 

supports square matrix multiplication of order \\ k\, and, therefore, by (4-^1), we have: 

k=i 

(5.5) a(S ym (A n ))< J; ( lg n X% y 



This yields concrete estimates for a(Sym m ), to be described in Chapter 6. 



5.2.2 Semidirect Product and Wreath Product Groups 

A group G is said to be the (internal) semidirect product A x B of a subgroup B < G by a 
normal subgroup ^4 < G, if A n B = {Iq} and G = AB. Each elements g e G = A y\ B 
has the form g = ab for a unique element a e A and a b e B depending on a, and by A < G, 
it is the case that fc^ 1 */ = b~ 1 ab e A. For a fixed b e B, the mapping a 1 — > bab^ 1 = a b , 
a e A, defines an automorphism ab of A which is conjugation of A by 6, and the mapping 
b 1 — ► Qb, 5 t B, is a group homomorphism a : B — > Aut(A) defining the conjugation action 
of B on A, such that multiplication of elements g = (ab),g = (ab') e G can be expressed as 
gg = (ab)(ab') = (aba'b~ l bb') = (aa b )(bb') = (aab(a'))(bb'), and inverses of elements g = ab 
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are given by g' 1 = a b -i(a^ 1 )b^ 1 . If B < G also then G = AxB = AxB. If A and B are 
arbitrary groups, then for any homomorphism <j> : B — ► Aut(A) there is a unique (external) 
semidirect product A x B of B by A, with underlying set Ax B, for which ccf, = <p(b) for any 6 e 
£, and A = Ax{l B } = [A] < ,4x5 and £ ^ {U}x-B = [5] < ^ x 5 such that [A]n[B] = {1 G } 
and G = [A][B]. Every external semidirect product A x B of groups ^4 and 5 is the internal 
semidirect product [A] x [5] of the subgroups [A] <\ A x B,[B] < A x B. If 7r : G — ► GL(V) 
is any nontrivial representation of G, and la denotes the inclusion homomorphism A — ► G = 
A x B, then tta = tt o is the representation A — ► GL(V) of ^4 equidimensional with 7r and 
a nontrivial subrepresentation of n. If tta is irreducible then 7r must be irreducible, while any 
irreducible representation g B of B extends to a unique irreducible representation g of G. For 
an Abelian subgroup A <\ G and a subgroup B < G there is a proper subgroup C < B such that 
an irreducible representation of A < G. extends to an irreducible representation of G = 4 xi B. 

A special kind of semidirect product group G = A x B exists when A = H n , the n-fold 
direct product of H, with H being a group, and B = Sym n , where multiplication in H n is 
component- wise multiplication of n-tuples h = (hi)™ =1 of elements of H, and multiplication in 
Sym n is the composition of permutations fx of n elements. This group G = i? n x Sym n is called 
the wreath product of Sym n by iJ n , denoted by 2 Sym n , where the action of Sym n on H n is 
from the right, defined by the mapping h i — ► /i' 1 := (fyui)™ =1 , for n-tuples /i = (/ij)™ =1 e i? n and 
permutations fi e Sym n , i.e. , Sym n acts on if n by permuting the components of its n-tuples. 
We sometimes write (h) i for the i th coordinate hi of an h = (/ij)" = i e H n . H is called the base 
group of H I Sym n , and if we identity H n with the subgroup {hls ymn \ h e H n } < H I Sym n , 
then H n < # ! Sym n and -ff i 1 Sym n becomes an internal semidirect product. Multiplication 
in Hi Sym n is given by (h[i)(ti //) = (hh ,fl )(////) = (hih' _ li )^ =1 (/xu'), and inverses (hfi)^ 1 
by /i^/U -1 = (h[ii) n =1 for elements (/t/x), (h' [/,') e If? Sym n . The following is an elementary 
result about the sums of u/^ powers of the irreducible character deg rees of .ff ^ Sym n . 

Lemma 5.7 For an Abelian group H, D^HlSymn) < {n^' 1 \H\ n . 

Proof. For an Abelian group H, and the wreath product group HlSym n , every irreducible 
representation g e Irrep(H I Sym n ) is induced from an irreducible representation of the base 
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group H n < Hi Sym n , which has the index [H I Sym n : H n ] = \Sym n \ = n\, [HUP1998]. 
Therefore, the index [H I Sym n : N] of any maximal Abelian normal subgroup N < H I Sym n 
is at most n\, and by Theorem 3.7, Dim g < n\ for any g e Irrep(H I Sym n ). Then: 



DUHlSym n ) £ d% 

g e Irrep(HlSym n ) 



< 



g e Irrep(HlSym n ) 
w-2 



< 



q e Irrep(HlSym n ) 

n!) w ~ 2 \H I Sym n \ 
n\f' 2 (n\)\H n \ 



4 



nl 



\0J-1 



D 2 (H) n 



Since H is Abelian D U (H) = \H\, and the result follows. 



We conclude with some extension results. 



Theorem 5.8 If {(Si, Tj, C/j)}™ =1 C 2(H) is a collection of n simultaneous index triples of a 

(n n n \ 

J] <Si ? Sym n , f\ T, ! Sym n , n C/j ! 5ym„ e 2 (H I Sym n ) . 
i=i i=i i=i / 

Proof. Assume a collection {(Sj, Tj, f/j)}™ =1 C 5 (if) of index triples of if. By Lemma 

(n n n \ 

f7 5j = 5, n Tj = T, FJ c/j = ?7 I is an index 
i=l i=l i=l / 

triple of if n . Assume further that the triples (Si,Ti, Ui) have the simultaneous triple product 
property (STPP). We claim that the subsets 



S I Sym n : = {(sa) \ s e S, a e Sym n } , 
T I Sym n : = {(tr) \ t e T, re Sym n } , 
U I Sym n : = {(uv) \ u e U, v e Sym n } , 
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satisfy the triple product property (TPP) in H I Sym n . To see this, let sia±, s^a^ e S I Sym r 
t 2 T2, t' 2 T' 2 e T I Sym n ,usVs, u' 3 v' 3 e U I Sym n be arbitrary elements. Then 

(sia'i) (sxai)' 1 (t' 2 T 2 ^ (t 2 r 2 )~ 1 (1*3^3) («3^3) _1 

' ' CTl -1/ ' T 2 -1 ' ' V 3 -1 

= s 1 a 1 s 1 1 a 1 t 2 T 2 T 2 2 r 2 u 3 v 3 u 3 3 v 3 

1 -1 ' -1 ' -1 

= s^ 1 a 1 a 1 t 2 t 2 2 t 2 t 2 v 3 v 3 

= 1 

=> <7i<rr lr 2l-2 lu 3 v 3 1 = 1. 



Putting |U = o' 1 o 1 1 and 1/ = o\u x 1 t' 2 t 2 1 we have that 



' -1 ' -1 ' -1 

' ' -lj.' j. r 2 r 2 ' -1 ' V 3 V 3 ' -1 

s l s l <*\<*\ *2*2 T 2^2 U 3 U 3 V 3 V 3 



= 1 



("3 ')( (sr 1 )^ (4) (i . te'L (%)_. = 1 

Hi = vi = i,l<i<n (STPP for {(5*,^, C/i)}" =1 
\x = v = 1 

0"! = cr'i,T2 = r 2 ,^3 = v' 3 . 



Thus 



' CT 1 Cr 1 ' _1 ' r 1 T, ' _1 ' UjD, ' _i 

O'lO'i E;iA r l r l ^1^1 



^2^2 ^3^3 = ^ 



Sl = Sl , t 2 = t 2 , % = u 3 (TPP for {(^, Ti, Ui)} n i=1 ) 
Putting these two together we deduce that for sicri, s\a\ e SlSym n , t<iT<i, t' 2 T 2 e T\Sym n , U3V3, 
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u' 3 v' 3 e U I Sym n it is the case that 



1 -1 ' -1 ' -1 

' CT 1 cr 1 ' -l' T 1 T 1 1 _1 ' ' _1 

= 1 

This proves our claim. ■ 



Corollary 5.9 // {{rrii,pi, (?i)}™ =1 C & (H) is a collection of n tensors simultaneously realized 
by an Abelian group H then 

In n n \ 

(1) ninm^in^nlllffi e 6 (H I Sym n ) 
\ j=i j=i j=i / 

and 

^ ^ < nlogjffj -logn! 



log w n 



i=l 



Proof. If n triples Si,TiU{ C H, 1 < % < n, of sizes = mj, |TjJ = pj, = (/j, 
1 < i < n, satisfy the STPP in an Abelian group H then by Theorem 5.8 H\Sym n realizes the 



n n 



product tensor ( n\ \\ mi, n\ \\pi, n\ \\ qi ) once, and in addition, by Corollary 5.2 and Lemma 
\ i=i i=i i=i I 

5.7, 

n n n \ ~ 

n\\[mi ■ n\\[pi ■ n\\[qi 

i=l i=l i=l 



= Yl niiPiqi 

< D^HlSymn) 
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Taking logarithms, this is equivalent to 



uj log I n! y Yl m iPiQi 1 < ( w — 1) logn! + nlog \H\ 



uj log n! + uj log i 3 / n niiPiqi < uj log n! — log n! + n log \H\ 
V i=i 

nlog — logn! 
W / ~ 

lo e y n ™>iVi<ii 



The bound for in Corollary 5.9 suggests that uj is close to 2 if we could find an Abelian 
group H simultaneously realizing n tensors (mi,pi, ft) such that nlog ^~ logw! is close to 2, and 



the following proposition is an obvious extension. 



lo § \ Tl m iPi<li 



= 1 



Proposition 5.10 For any n, given n triples Si,TiUi C H of sizes \Si\ = rm, |Tj| = p^, |£/j| = 
ft, 1 < i < n satisfying the STPP in an Abelian group H , and the corresponding product triple 

n n n 

Q SilSym n , \\TilSym n , \\ UilSym n satisfying the TPP in the wreath product group H\Sym n , 

i=l i=l i=l 

there is a maximum number 1 < k n < (n!) 3 triples of permutations, aj,Tj,Vj e Sym n , 1 < j < 

nun 

k n , such that the k n permuted product triples Y\ S<r-(i) I Sym n , f\ T Tj ^ I Sym ni Y\ U Vj ^ I Sym n , 

i=l i=l i=l 

1 < j < k n , satisfy the STPP in H I Sym n , and H I Sym n realizes the square product tensor 

n n n \ 

n! Y\ n^i, n\ YlPi, n! Yl Qi ) k n times simultaneously, such that 
i=i i=i i=i I 

nlog I .Hi — logn! — log/c ra 
uj < . 



/ n 

lo s y EI m iPiQi 



The proof of this result once again uses the result D U (H I Sym n ) < (n!) w_1 \H\ a for an 
Abelian group H (Lemma 5.7), in combination with Corollary 5.2, as described in the proof 
of Corollary 5.9. By Theorem 5.8 we know that k n > 1 for any given n, given n STPP triples 
Si,TiUi C H of sizes \Si\ = mi, |Tj| = = ft, 1 < i < n. If the aj,Tj,Vj e Sym n , 
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1 < j < k n , are taken independently of each other in Sym n , there are a maximum number 

n n n 

(n!) of permuted triples J] ! S?/m n , J] T T ^ I Sym n , Y\ U v {i) I Sym n , a,T,v e Sym n , and 

i=l i=l i=l 

if these satisfy the STPP in Hi Sym n , it leads to the conditional estimate u) < 2.012 using the 
wreath product group (Cycg 3 ) x6 I Sym 2 &, as described in section 6.2.3. For a given n, there 
is no known general method of determining k n for the group H I Sym n , with H being Abelian 
and having a family of n STPP triples Si,TiUi C H of sizes = mj,|Tj| = Pi,|J7j| = 
1 < z < n. The objective is to find the number 1 < k n < (n!) 3 of these triples of permutations 
in Sym n such that the bound u < " lo gl H H°g" ! ~ lo s fc "- j s as tight as possible. It so happens 

that Theorem 7.1, [CUKS2005], is a special case of Proposition 5.10 for k n = 1, except there 
the group is not required to be Abelian. 
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Chapter 6 
Applications 



In this chapter, we apply the methods and general results in Chapters 4-5 to describe the general 
conditions needed to prove results for to using the parameters a and 7 of concrete families of non- 
Abelian groups or of single non-Abelian groups. We conclude with a number of concrete upper 
estimates of to in the region 2.82—2.93. However, our most important result is a general estimate 
that lo < 2 logr L ~i log / 2 -~^ & k 2 n f or gome undetermined 1 < kw < (2™!) 3 , where this fe" is the 

/ \ x2 n 

number of times the wreath product group (Cyc* 3 ) lSym2" (i.e. ( (Cyc^ 3 ) J x5j/m2») 
realizes the product tensor (Vl (n - l) n2 ™ , 2 n ! (n - l) n2 ™ , 2 n ! (n - l) n2 ™^> simultaneously, and 
the closer A^™ is to (2 n !) 3 the closer lo is to 2.02 (from the upper side). 

6.1 Analysis of a and 7 for the Symmetric Groups 

Here we derive upper estimates of a and 7 for the symmetric groups Sym (A n ) = Sym n ^ n+l y 2 , 
and generally for Sym m . We start with 7 (Sym (A n )). 

6.1.1 Estimates for 7 (Sym (A n )) 

Our first estimate for (Sym(A n )) follows from McKay's estimate of d' (Sym n ) [MCK1976, p. 
631]. 
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(6.1) 2^6 (^±i) 



n(n + l) 



+ 1 



/ n(n+l) 7r /T^\ "("+!)+! , 

;V — ^C 1 -!*^) 4 < d ' (Sym(A n )) < 



2ire 



1 n(n + l) + l 

■ ^ 2 ^ n (n+l) \ 4 



This yields the following result for ^(Sym (A n )). 

Corollary 6.1 7 (Sym (A n )) = 2 + 0(±). 

Proof. Applying (4-26) and f5.<?,) to and using Stirling's formula, we have the initial 

estimate 



7 (Sym(A n )) > 



7(Sym(A n ) < 



n 2 log n — in 2 (1 + log 2) + O (n log n) 



log 



>i.(n+l) + l 



n 2 log n — \ri 2 (1 + log 2) + O (n log n) 



log 



2^6 (! 



(n+l) \ =^+1 y^li(i_ f V6)-^l±i 



2 ; 



Dividing numerator and denominator on both sides above by n 2 logn — \n 2 (1 +log2), and 
then dividing O(nlogn) by n 2 logn, we arrive at the result. ■ 

A second estimate of 7 (Sym (A n )) follows from Vershik and Kirov's estimate of d' {Sym (A n )) 
[VK1985, p. 21]. 



(6.2) e^^M^fl < d (Sym (A n) ) < ^ M^)\, 



where C±, C2 > constants independent of n. 



Corollary 6.2 7 (5ym (A n )) = 2 + 9 (^) . 
Proof. Consequence of (6.2). 



j(Sym(A n )) > 
7 (5ym(A n )) < 



n 2 log n - \n 2 (1 + log 2) + O (n log n) 



Ci^+l) + i n2 lQg n _ 1 n2 (1 + bg 2) + 1 Q (n bg n) 

n 2 log n - \n 2 (1 + log 2) + O (n log n) 



Ci , /n(n+l) , i 2 



+ |n 2 log n — |n 2 (1 + log 2) + \0 (n log n) 
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for positive constants C\ and C<i- Dividing numerator and denominator on both sides by 
n 2 logn, we obtain the result. ■ 



6.1.2 An Upper Estimate for a(Sym(A n ) 
The main result here is that a(Sym (A n )) < 2 + 0(j^^). 

Lemma 6.3 a(Sym (A n )) < 2 + O(^). 

In n n \ 

Proof. \Sym(A n )\ = (±n(n + 1)) !, and ( \[ k\, U k] ) e 6 (Sym(A n )) (Lemma 5.6), 

\k=l k=l k=l I 

and implies that a(Sym(A n )) < i g°^f(^ 1 )t. 1 ." > 2!i!) by (4-22). By Stirling's asymptotic formula 
log n! ~ n log n — n + O (log n) , as n — > oo, we have 

logQn(n + l)^! = ^n(n + 1) log Qn(n + 1)^ - ^n(n + 1) + O ^log Qn(n + 1)^ 
= n 2 log n — -n 2 ( 1 + log 2) + O (n log n) . 

For log (n!(n — 1)! • • • -2!l!) we have the estimate: 

log (n!(n - 1)! • • • -2!1!) = log (2 ri - 1 3"- 2 ....n) 
= {n- l)log2 + {n - 2) log 3 + .... + 21og(n - 1) +logn 
= n(log2 + .... + logn) - (log 2 + 2 log 3 + .... + (n - l)logn) 
= nlog(n!) — (log 2 + 2 log 3 + .... + (n — l)logn) . 

Now, nlogn! = n 2 logn — n 2 + O (n logn), and (log 2 + 2 log 3 + .... + (n — 1) log n) is the 
result of the evaluation of the definite integral J™ (x — l)logx dx + O (nlogn), which be- 
comes \ (x — l) 2 logx — \ J*™ dx + O (nlogn) when we integrate by parts. We find 
that \ (x - l) 2 logx ™ - \ J™ ^f^- dx + O (nlogn) = \n 2 logn - \n 2 + O (nlogn). Thus, 
(log 2 + 2 log 3 +.... + (n — 1) log n) = |n 2 log n — in 2 + O (n log n) which implies the estimate 
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for log (n!(n - 1)! • • • -2!1!) of 



log (n!(n- 1)! • • • -2!1!) 
= nlog (n!) — (log 2 + 2 log 3 + .... + (n — 1) logn) 

= n 2 log n — n 2 + O (n log n) — -n 2 log n + -n 2 — O (n log n) 

1 3 
= -n 2 log n — -n 2 + O {n log n) . 



Then for \og^(n-i^^2\V.) we nave * ne estimate: 



log(|n(n + l))! 



log (n!(n- 1)! • • • -2!1!) 



n 2 log n - \n 2 (1 + log 2) + O (n log n) 



\n 2 log n — |n 2 + O {n log 



7? 



2 _ i+iog2 +0 m 

log n \n/ 
1 2 logn ^ W \n! 

1 \ / 3 1 \ „ / 1 



= 2-(l + log2)-— l + - +0 



log n/ V 2 logn/ V(logn) 



„ 2 - log 2 ^ ( 1 
2 + — — + 



= 2 + 



log n V (log n 

1 



logn 



If we denote by z (Sym (A„)) the size of the maximal tensor realized by Sym(A n ), then 
we have following corollary. 

Corollary 6.4 ni Ti2+ °W (2e)"5 n2 < z (Sym{A n ))^ < n ¥ 2 +°^) (2e)~2™ 2 . 

Proof. \Sym(A n )\ = (±n(n + l))!, and by $.j23j (±n(n + l))! < z (Sym(A n )) < ((±n(n + l))!) 
Taking logarithms on all sides, and substituting the estimate log Qn(n + 1)) ! = n 2 logn — 
\r? (1 + log 2) + O (nlogn) from Lemma 6.3, and taking antilogarithms, we obtain the result. 
z (Sym(A n ))3 is the maximal mean size of matrix multiplication supported by Sym(A n ), 
and the result describes bounds for these in terms of the order of Sym(A n ), which grows 
exponentially with n. ■ 
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Lemma 6.3 shows that it suffices to work with the symmetric groups Sym(A n ) since for 
every integer m > 2, there exists an integer n > 1 such that (^n(n + 1))! | m\. 

6.1.3 An Upper Estimate for a(Sym n ) 

Following Lemma 6.3 we show that a similar estimate applies to the a(Sym n ) of arbitrary 
symmetric groups Sym n . 

Corollary 6.5 a(Sym n ) <2 + (^) + O ( ^__*) + O ) , for some m<n. 



Proof. It suffices to prove that a(Sym n ) < a (Sym (A m )) + O y m ( m+ i) j , f° r some integer 
m < n. By Lagrange's theorem the order \H\ of a proper subgroup H < G is a proper divisor 
of the order \G\ of G. For every integer n > 2, there exists an integer to > 1 such that 

m 

(^m(m +1))! | n\. This is most obviously the case when n = ^fc = Z m = (^to(to + 1)), i.e. 

i=i 

when n is the sum of the first m positive integers for some to, in which case Sym n = Sym (A m ), 
and a{Sym n ) = a (Sym (A m )). If Z m < n < Z m+ i for some m, then ^m(m + 1) < n — 1 < 
\ (to. + 1) (to, + 2), and this m is the least integer such that (^m(m + 1)) ! is the largest proper 
divisor of n\. Consequently, for this m, Sym (A m ) occurs as the maximal subgroup of Sym n 
of order \Sym(A m )\ = (^m(m + 1))! < (n — 1)!. We can deduce from these facts, by using 
Lemma 4-19 that: 



a{Sym n ) < a(Sym (A m )) + log z ' (5 j /m(Am)) i/3 [Sym n : Sym (A m )] 
< a(Sym(A m )) + 



log ^m(m + 1) + 1 



log(z'(5ym(A m )))3 

loff — JTl( 7TI ~\- ~ h 1 

< a(Sym(A m )) + - f 2 \ ; (using 
3 1 log (±m(m + lj! 



a(S , ym(A m )) + 
a(5ym(A m )) + 



a(Sym (A m )) + 



3 log \m(m + 1) + 1 

2~ 1 to(to + 1) log \m(m + 1) - 1 
3 

2- l m(m + 1) 
1 



m (m + 1) 



log to \ (log to) J \m(m+l 
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Lemma 6.5 shows that it suffices to work with the symmetric groups Sym(A n ). 
6.1.4 Applications to uj 

Here we examine the implications of the above analysis for u using the groups Sym (A n ). 

By Lemma 6.3 a{Sym (A n )) = 2 + 2 1 Jf + O = 2 + O(^). For as small as 

n > 4, the leading term 2 + 2 ^'°^ 2 < 3. The following is a table of values of 2 + 2 ^°^ 2 for 
2 < n < 10. 



n 


|Sym(A n )| 


log(fn(n+l))! 


log(n!(n-l)!----2!l!) 


2 


6 


3.88539 


3 


720 


3.18955 


4 


3,628,800 


2.94270 


5 


1.30767 x 10 12 


2.81199 


6 


5.10909 x 10 19 


2.72937 


7 


3.04888 x 10 29 


2.67159 


8 


3.71993 x 10 41 


2.62846 


9 


1.19622 x 10 56 


2.59477 


10 


1.26964 x 10 73 


2.56756 



\Sym (A n )| — > oo of the order of n™ 2 , much faster than 2 + 2 ~ 1 °^ 2 — > 2. Lemma 6.3 (or 
Lemma 6.5) shows that a(Sym (A n )) — 2 = O (7 (Sym (A n ))), which is contrary to the limit 
condition of Corollary ^.28 needed to prove uj = 2, i.e. we cannot prove to = 2 using the limit 
results Corollary 4-30 or Theorem 4-31 for the family of groups Sym (A n ). 

However, the application of Corollary 4-^9, and the estimate \Sym (A n )| = ^ n ( n + 1 ) ^ 1 _ 
n ^n 2 +Kn (2e) _ 2™ j where K is some constant independent of n, this yields the following open 
question. 
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Problem 6.6 Is there a symmetric group Sym (A n ) , for some n > 1, such that z (Sym (A n ))3 > 
J (Sym (A n )) and i ^ ym ^ll 2 > nh 2 + Kn (2e)~5™ 2 , for some 2<t<3, where K is a con- 
stant independent of nl 



6.2 Some Estimates for the Exponent u 

Here we derive a number of estimates for to, using wreath products of Abelian groups with 
symmetric groups. We start with the Abelian group Cyc* 3 = Cyc n x Cyc n x Cyc n , for which 
we start with a basic lemma. 

Lemma 6.7 For the Abelian group Cyc* 3 the subset triples (S±,T±, U\) and (S 2 , T 2 , U 2 ) defined 
by 

51 : = Cyc n \ {1} x {1} x {1} , T x := {1} x Cyc n \ {1} x {1} , V x := {1} x {1} x Cyc n \ {1} , 

5 2 : = {1} x Cyc n \ {1} x {1} , T 2 := {1} x {1} x Cyc n \ {1} , U 2 := Cyc n \ {1} x {1} x {1} , 

(1) have the triple product property, and (2) have the simultaneous triple product property. 

Proof. (1) For arbitrary elements (V,l, l) , (s, 1, 1) e Si = Cyc n \ {1}x{1}x{1}, , (M, 1) 

e Ti = {1} x Cyc n \{l} x {1}, (l,l,u') ,(1,1,«) e 17 = {1} x {1} x Cyc n \{l}, the condition 
(s',l,l) (l,t',l) (l,l,«) = (aVVrViT 1 ) = (1,1,1) can 

only occur if s = s, t = t, u = u, which implies that (^s , 1, 1^ = (s, 1, 1) , ^1, t , l^j = (1, i, 1) , 
^1, l,u ^ = (1, l,it). Thus, (SijTi, C7i) has the triple product property, and we can prove the 
same for (S 2 , T 2 , U 2 ). 

(2) Refer to Proposition 5.2, [CUKS2005]. ■ 
The following is an elementary corollary. 

Corollary 6.8 The Abelian group Cyc* 3 realizes the tensor (n — 1, n — 1, n — 1) 2 iimes si- 
mti/taneotis/y. 

Proof. Consequence of definition (5.2) with respect to the triples in Lemma 6.11. m 
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6.2.1 co < 2.82 via Cyc%$ 



By Corollary 6.12 Cyc* 3 realizes the identical tensors (n — 1, n — 1, n — 1) and (n — 1, n — 1, n — 1) 
simultaneously, and, thereby, supports two independent, simultaneous multiplications of square 
matrices of order n — 1, and by Corollary 5.3, we have the inequality 

log n 3 — log 2 
~~ log (n — 1) 

The expression lo j ) 2 achieves a minimum 2.81553... for n = 16, i.e. w < 2.81554. 
6.2.2 uj < 2.93 wa Cyc^ I Sym 2 

From above, Cyc* 3 realizes the tensor (n — 1, n — 1, n — 1) 2 times simultaneously. By part 

„ / 2 2 2 \ 

(1) of Corollary 5.9 Cyc* I Syrri2 realizes the tensor ( 2 {n — 1) , 2 (n — 1) , 2 (n — 1) ) once, 
and by part (2) 

6 log n — log 2 
W ~ 21og(n- 1) ' 

The minimum value to < 2.92613048... is attained for n = 41. 

More generally, by Proposition 5.10 Cyc* 3 lSyrri2 realizes the product tensor ^2 (n — l) 2 , 2 (n — l) 2 , 2 (n — 1 
some 1 < k 2 < (2!) 3 times simultaneously such that 



6 log n — log 2 — log /c2 
W ~ 2 log (n- 1) 

^. 6 log n — log 2 
~ 2 log (n - 1) 
< 2.93. 

If, for example, k 2 = (2!) 3 we would have 6 log ^-^ 2 _- 1 ) og fca = ^ggff , which achieves 
a minimum of 2.478495... at n = 6. The following table gives minima for the expression 
61og 2 n -'° g n 2 _- 1 ) ogfc2 for the values of 1 < k 2 < (2!) 3 : 
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kn 


to ^ mm ^ 21og(n-l) J 


1 
1 


9 Q9R1 


o 
z 


z.oiuo 


Q 
O 


9 7^1 
Z. 1 O01 


A 


9 R7nn 

Z.D 1 UU 


(j 


9 fil 49 


6 


2.5647 


7 


2.5200 


8 


2.4785 



Here we know only the case = 1 based ultimately on Theorem 5.8, and we conclude that 
u < 2.9261, and for the values 2 < k2 < 8 the table's bounds for oj are conditional on those 
values of fo. 

6.2.3 u < 2.82 wa (C?/c 2 x 5 3 ) x25 2 ^m 2 25 

As before, we start we start with Cyc* 3 , which realizes the tensor (n — 1, n — 1, n — 1) 2 times 
simultaneously. By Corollary 5.5 the m-fold direct product (C?/c* 3 ) xm realizes the pointwise 
product tensor ((n — l) m , (n — l) m , (n — l) m ) 2 m times simultaneously. By part (1) of Corol- 

(\ x2 m 
(Cyc* 3 ) J xi Sym2m) realizes the product 

tensor (2 m l (n - l) rra , 2 m ! (n - l) 2 ™" 1 , 2 m ! (n - l) 2 " 1 "^ once, and by part (2) 

2 m logn 3m -log2 m ! 

2 m mlog (n — 1) 
3m log n — m log 2 + 1 
m log (n — 1) 

If we let m — ► oo the right hand side tends to 2.815... we derive that u < 2.82, as good a 
result as in section 6.2.1. 

If we consider the n-fold direct product (C?/c* 3 ) xra , then more generally, by Proposi- 

/ \ x2 n 

tion 5.10 (Cyc* 3 ) I Sym^"- (i.e. ( (Cyc* 3 ) J x Sym2") realizes the product tensor 
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^2 n !(n-l) n2 ",2 n !(n-l) n2 ",2 n !(n-l) n2 ^ some 1 < k 2 « < (2 n !) 3 times simultaneously 
such that 

2 n log n 3n - log 2 n \ - log k 2 n 
2 n nlog (n — 1) 

If here fc 2 ™ = (2™!) 3 then u < 2 " "^n-j) 2 "' , the latter achieving a minimum of 2.012 for 
n = 6. In general, for the groups (Cyc* 3 ) xn i 1 Syni2^ the closer /c2« is to (2™!) 3 , the closer we 
could push ijj down towards 2.012 (from the upper side). 

These results point to the utility of finding triples of permutations Uj,Tj,Vj e Sym n in order 

3 n n 

that a maximum number 1 < k n < (n!) of permuted product triples Yl S a .(«) I Sym n , Y\ (j) I 

i=l ' i=l 

n 

Sym n , Y[ U v .^ I Sym n , 1 < j < k n , satisfy the STPP in H I Sym n , where H is Abelian with 
a given STPP family {(Si, T{Ui)}™ =1 . Using such groups and their triples in this way, the 
sharpest upper bounds for u> will occur where the ratio k n / (n!) 3 is highest. Therefore, we pose 
the following problem. 



Problem 6.9 For any given n, and group H\Sym n , with H being Abelian, and a given family 
{(Si, TiUi)}™ =1 of n STPP triples of H, what is the largest number 1 < k n < (n!) 3 such 

n 

that there are k n triples of permutations aj , Tj , Vj e Sym n such that the k n triples Y\ S a - u\ I 

1 = 1 

n n 

Sym n , n^V^i) I Sym n , ]J U v .^ I Sym n , 1 < j < k n , satisfy the STPP in H I Sym n ? 

i=l i=l 
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